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TIER ONE PERFORMANCE SCREEN INITIAL OPERATIONAL TEST AND 
EVALUATION: 2014 ANNUAL REPORT 

EXECUTIVE SUMMARY 


Research Requirement: 

In addition to educational, physical, and moral screens, the U.S. Army relies on the Armed Forces 
Qualification Test (AFQT), a composite score from the Armed Services Vocational Aptitude 
Battery (ASVAB), to select new Soldiers into the Army. Although the AFQT has proven to be and 
will continue to serve as a useful metric for selecting new Soldiers, there is a growing recognition 
of the need to conduct whole person assessment that takes other personal attributes, in particular 
non-cognitive attributes (e.g., temperament, interests, and values) into consideration. Non- 
cognitive attributes are important to entry-level Soldier performance and retention (e.g., Campbell 
& Knapp, 2001; Ingerick, Diaz, & Putka, 2009; Knapp & Heffner, 2009, 2010; Knapp & Tremble, 
2007). Based on previous research (Knapp & Heffner, 2010), the Army selected one particularly 
promising measure, the Tailored Adaptive Personality Assessment System (TAPAS), as the basis 
for an initial operational test and evaluation (IOT&E) of the Tier One Performance Screen (TOPS). 
The TAPAS capitalizes on the latest advances in testing technology to assess motivation through 
the measurement of personality characteristics. 

Procedure: 

In May 2009, the Military Entrance Processing Command (MEPCOM) began administering the 
TAPAS on the computer adaptive platform for the ASVAB (CAT-ASVAB) at Military Entrance 
Processing Stations (MEPS). To evaluate the TAPAS, outcome (criterion) data are being collected at 
multiple points in time from Soldiers who took the TAPAS at entry. Specifically, initial military 
training (IMT) criterion data are being collected at schools for Soldiers in eighteen military 
occupational specialties (MOS). Project teams also are collecting criterion data from Soldiers 
(regardless of MOS) in their units in multiple waves of site visits during the course of the Initial 
Operational Test and Evaluation (IOT&E). 

The criterion measures include job knowledge tests, an attitudinal assessment (the Army Life 
Questionnaire), and performance rating scales completed by the Soldiers’ cadre members (in IMT) or 
supervisors (in units). Additional criterion, course grades, completion rates, and attrition status are 
obtained from administrative records for all Soldiers. 

The data presented in this report come from TAPAS data collected through September 2014 and 
criterion data collected through December 2014. It consists of a total of 623,480 applicants who 
took the TAPAS; 573,146 of these individuals were in the TOPS Applicant Sample. The 
Applicant Sample (used for analysis purposes) excluded those ineligible for service based on 
education requirements or extremely low AFQT scores and prior service applicants. The 
validation sample sizes were considerably smaller, with the IMT Validation Sample comprising 
27,372 Soldiers, the In-Unit Validation Sample comprising 3,105 Soldiers, and the 
Administrative Validation Sample (which includes Soldiers with criterion data [e.g., attrition] 
from at least one administrative source) comprising 311,908 Soldiers. 
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Data from the job knowledge tests, performance-rating scales provided by cadre or supervisor, 
attitudinal assessment, and administrative sources were combined to yield an array of scores 
representing important Soldier outcomes. In general, the criterion scores exhibited acceptable 
and theoretically consistent psychometric properties. The exception to this was the performance¬ 
rating scales, which exhibit low inter-rater reliability. Results involving the rating scales may 
underestimate relationships with other variables. 

Our approach to analyzing the TAPAS’ incremental predictive validity was consistent with 
previous evaluations of this measure and similar experimental non-cognitive predictors (e.g., 
Ingerick et al., 2009; Knapp & Heffner, 2009, 2010, 2011). In brief, this approach involved 
testing a series of hierarchical regression models, regressing scores for each criterion measure 
onto Soldiers’ AFQT scores, followed by their TAPAS composite or TAPAS scale scores in the 
second step. The resulting increment in the multiple correlation value (A R) when the TAPAS 
composite or TAPAS scale scores were added to the baseline regression models served as our 
index of incremental validity. Correlations between TAPAS scale scores and selected criteria 
were also examined. Analyses used the TAPAS Will-Do, Can-Do, and Adaptation composite 
scores. 

To further examine the relationships between the TAPAS and the various IMT, in-unit, and 
attrition criteria, we conducted analyses that assessed implementation of the TAPAS with respect 
to AFQT categories and TAPAS score percentiles. For some of these analyses, AFQT Category 
IIIB/IV Soldiers were classified as either IIIB/IV Pass or IIIB/IV Fail based on their TAPAS 
Will-Do composite scores, with Soldiers scoring among the bottom 10% classified as IIIB/IV 
Fail. 

Findings: 

Consistent with previous TOPS IOT&E reports, the results of this evaluation suggest TAPAS 
holds promise for new Soldier selection. Results of the incremental validity analyses indicate that 
the TAPAS predicts important first-term criteria over and above the AFQT, especially measures 
tapping motivational aspects of Soldier performance, such as physical fitness, adjustment to 
Army life, commitment and fit, and discipline. Further, examination of AFQT categories and 
quintile splits of predictor composites showed a clear linear improvement in favor of higher 
scoring individuals. Individuals in the lowest AFQT categories performed the worst. 

The Will-Do composite, a combination of TAPAS scales that predict motivation-based outcomes, 
was associated with the greatest incremental validity gains compared to other TAPAS composites. 
This was especially tme for the prediction of physical fitness, Will Do Performance, and Army Life 
Adjustment. When examining outcomes by AFQT category, a clear distinction was seen when 
comparing the IIIB and IV Pass groups and the corresponding IIIB and IV Fail groups. One 
particularly large difference was for disciplinary incidents where the MB and IV Fail groups had 
approximately 5% and 8% more disciplinary incidents, respectively, compared to the MB and IV 
Pass groups. Results showed consistently higher attrition among the MB and IV Fail AQFT 
categories. The MB and IV Pass groups had lower attrition rates (ranging from a difference of 
1.2% to 5.6%) than the MB and IV Fail groups at 6, 12, and 24 months’ time in service. The 
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Adaptation composite generally provided small incremental validity gains for predicting 
attrition, showing relatively larger gains for predicting attrition later in the enlistment term. Even 
these small gains in validity are important, particularly given the modest relationship with the 
AFQT. 

Utilization and Dissemination of Findings: 

The research findings will be used by the Army Deputy Chief of Staff, G-l; U.S. Army 
Recruiting Command; Assistant Secretary of the Army (Manpower and Reserve Affairs); and 
Training and Doctrine Command to evaluate the effectiveness of tools used for Army applicant 
selection and assignment. With each successive set of findings, the TAPAS can be revised and 
refined to meet Army needs and requirements. 
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EVALUATION: 2014 ANNUAL REPORT 


CHAPTER 1: INTRODUCTION 

Deirdre J. Knapp (HumRRO), Tonia S. Heffner, and Leonard A. White (ARI) 

Background 

The Personnel Assessment Research Unit (PARU) of the U.S. Army Research Institute for the 
Behavioral and Social Sciences (ARI) is responsible for conducting personnel research for the 
Army. The focus of PARU’s research is maximizing the potential of the individual Soldier 
through effective selection, classification, and retention strategies. 

In addition to educational, physical, and moral screens, the U.S. Army relies on the Armed Forces 
Qualification Test (AFQT), a composite score from the Armed Services Vocational Aptitude 
Battery (ASVAB), to select new Soldiers into the Army. Although the AFQT has proven to be and 
will continue to serve as a useful metric for selecting new Soldiers, other personal attributes, in 
particular non-cognitive attributes (e.g., temperament, interests, and values), are important to entry- 
level Soldier performance and retention (e.g., Knapp & Tremble, 2007). 

In December 2006, the Department of Defense (DoD) ASVAB review panel—a panel of experts 
in the measurement of human characteristics and performance— released their recommendations 
(Drasgow, Embretson, Kyllonen, & Schmitt, 2006), several of which focused on supplementing 
the ASVAB with additional measures for use in selection and classification decisions. The 
ASVAB review panel further recommended that the use of these measures be validated against 
performance criteria. 

Just prior to the release of the ASVAB review panel’s findings, ARI had initiated a longitudinal 
research effort, Validating Future Force Performance Measures (Army Class), to examine the 
prediction potential of several non-cognitive measures (e.g., temperament and person-environment 
fit) for Army outcomes (e.g., performance, attitudes, attrition). The Army Class research project 
was a six-year effort conducted with contract support from the Human Resources Research 
Organization ([HumRRO]; Allen, Knapp, & Owens, 2013; Ingerick, Diaz, & Putka, 2009; Knapp 
& Heffner, 2009). Experimental predictors were administered to new Soldiers in 2007 and early 
2008. Army Class collected school-based criterion data on a subset of the Soldier sample as they 
completed job training. Job performance criterion data were collected from Soldiers in the Army 
Class longitudinal validation sample in 2009 with a second round of data collections in Soldiers’ 
units completed in April 2011 (Knapp, Owens, & Allen, 2012). Final analysis and reporting of this 
program of research is complete (Allen et al., 2013). 

After the Army Class research began, ARI initiated the Expanded Enlistment Eligibility Metrics 
(EEEM) project (Knapp & Heffner, 2010). The EEEM goals were similar to Army Class, but the 
focus was specifically on Soldier selection and the time horizon was much shorter. Specifically, 
EEEM required identification of one or more promising new predictor measures for immediate 
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implementation. The EEEM project capitalized on the existing Army Class data collection 
procedure and, thus, the EEEM sample was a subset of the Army Class sample. 

As a result of the EEEM findings. Army policy-makers approved an initial operational test and 
evaluation (IOT&E) of the Tier One Performance Screen (TOPS). This report is the latest in a 
series presenting continuing analyses from the IOT&E of TOPS. 

The Tier One Performance Screen (TOPS) 

Six experimental pre-enlistment measures were included in the EEEM research (Allen, Cheng, 
Putka, Hunter, & White, 2010). These included several temperament measures, a situational 
judgment test, and two person-environment fit measures based on values and interests. The most 
promising measures recommended to the Army for implementation were identified based on the 
following considerations: 

• Incremental validity over AFQT for predicting important performance and retention- 
related outcomes, 

• Minimal subgroup differences, 

• Low susceptibility to response distortion (e.g., faking optimal responses), and 

• Minimal administration time requirements. 

The Tailored Adaptive Personality Assessment System ([TAPAS]; Stark, Chernyshenko, & 
Drasgow, 2010) surfaced as the top choice 1 . The TAPAS is a measure of personality 
characteristics (e.g., achievement, sociability) that capitalizes on the latest advances in 
psychometric theory and provides a good indicator of personal motivation. 

In May 2009, the Military Entrance Processing Command (MEPCOM) began administering the 
TAPAS on the computer adaptive platform for the ASVAB (CAT-ASVAB). Initially, the 
TAPAS was to be administered only to Education Tier 1, non-prior service applicants. 2 3 This 
limitation to Education Tier 1 was removed early in 2011 so the Army could evaluate the 
TAPAS across all types of applicants. 

TOPS uses non-cognitive measures to identify applicants who would likely perform differently 
(higher or lower) than would be predicted by their ASVAB scores. As part of the TOPS IOT&E, 
TAPAS scores have been used to screen out a small number of AFQT Category TUB and IV 
applicants/ 1 Recently, the IOT&E was modified to allow all Tier 1 Category TU B applicants to enlist 
regardless of TAPAS score (2015) and screen out Tier 2 applicants who scored below the 30* 
percentile on TAPAS (2014). 

The initial conceptualization for the IOT&E was to use the TAPAS as a tool for “screening in” 
Education Tier 1 applicants with lower AFQT scores, meaning allowing more Soldiers to come 


1 Other promising assessments include the Work Preferences Assessment ([WPA]; Putka & Van Iddekinge, 2007) 
and the Information/Communications Technology Literacy test ([ICTL]: Russell & Sellman, 2009). 

2 Applicant educational credentials are classified as Tier 1 (primarily high school diploma). Tier 2 (primarily non¬ 
diploma graduate), and Tier 3 (not a high school graduate). 

3 Examinees are classified into categories based on their AFQT percentile scores (Category I = 93-99, Category II = 
65-92, Category IIIA = 50-64, Category IIIB = 31-49, Category IV = 10-30, Category V = 1-9). 
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into the Army with lower AFQT than they otherwise would have. However, changing economic 
conditions spurred a reconceptualization that led to using the TAPAS as a tool that screens out 
low motivated applicants, thus making the selection criteria to enter the Army more stringent. As 
recruiting conditions continue to shift, the IOT&E, as well as operational implementations, can 
adjust to fit the applicant market. That is, TAPAS composite scores and cut points can be 
modified to fit recruiting market conditions. 

Evaluating TOPS 

To evaluate the TAPAS, the Army is collecting training criterion data on Soldiers in multiple 
target military occupational specialties (MOS) as they complete initial military training (IMT). 4 
The criterion measures include job knowledge tests (JKTs); an attitudinal assessment, the Army 
Life Questionnaire (ALQ); and performance rating scales (PRS) completed by the Soldiers’ 
cadre. These measures are computer-administered at the schools (IMT) for each of the eight 
target MOS. The process is overseen by Army personnel with guidance and support from both 
ARI and HumRRO. Course completion rates are obtained from administrative records for all 
Soldiers who take the TAPAS, regardless of MOS. 

Criterion data are also being collected from Soldiers and their supervisors during data collection 
trips to major Army installations. These proctored “in-unit” data collections began in January 
2011 and target all Soldiers who took the TAPAS prior to enlistment. The in-unit criterion 
measures include JKTs, the ALQ attitudinal assessment, and PRS completed by the Soldiers’ 
supervisors. The data collection model closely mirrors that which was used in the Army Class 
research program (Knapp et al., 2012). Separation status of all Soldiers who took the TAPAS 
prior to enlistment is tracked throughout the course of the research. 

This report describes the tenth iteration of the criterion-related validation through the TOPS 
IOT&E initiative. Prior evaluations are described in a series of technical reports (Bynum & 
Mullins, 2015; Knapp & Heffner, 2011, 2012; Knapp, Heffner, & White, 2011; Knapp & LaPort, 
2013a, 2013b, 2014) and internal memoranda. Additional validation analyses will be prepared 
and conducted at six-month intervals throughout the multi-year IOT&E period. 

Overview of Report 

Chapter 2 explains how the evaluation analysis data files are constructed and then describes 
characteristics of the current sample. Chapter 3 describes the TAPAS, including content, scoring, 
and psychometric characteristics. Chapter 4 describes the IMT and in-unit criterion scores used 
in this evaluation, including their psychometric characteristics. Criterion-related validation 
analyses for the TAPAS are presented in Chapter 5. The report concludes with Chapter 6, which 
summarizes our continuing efforts to evaluate TOPS and looks toward plans for future iterations 
of these evaluations. 


4 The target MOS are Infantryman (1 IB), Armor Crewman (19K), Military Police (31B), Human Resources 
Specialist (42A), Health Care Specialist (68W), Motor Transport Operator (88M), and Light Wheel Vehicle 
Mechanic (91B). These MOS were selected to include large, highly critical MOS as well as to represent the diversity 
of work requirements across MOS. Recently, five more target MOS have been added to the research plan, but data 
are not yet available for them. These MOS are Combat Engineer (12B), Cannon Crewmember (13B), Field Artillery 
Automated Tactical Data Systems Specialist (13D), Fire Support Specialist (13F), and Cavalry Scout (19D). 
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CHAPTER 2: SAMPLE CHARACTERISTICS 


Erin A. Smith, D. Matthew Trippe, and Chris R. Graves (HumRRO) 


This chapter describes characteristics of the samples used in the TOPS IOT&E evaluation 
analyses. We begin with a brief summary of data sources, describe how Soldier data were 
filtered for analysis, and then describe multiple subsamples that were created to support various 
types of analyses. 


Data Sources 

An illustrative view of the TOPS sources of predictor and criteria data is provided in Figure 2.1. 
The lighter boxes within the figure represent sources of data, and the darker boxes represent 
samples on which descriptive or inferential analyses are conducted. The leftmost column in the 
figure summarizes the predictor data sources used to derive the TOPS Applicant Sample. The 
other columns summarize the research-only (i.e., non-administrative) and administrative criterion 
data. Predictor and criterion data are merged to form the IMT, In-Unit and Administrative 
Validation Samples. 
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Figure 2.1. Overview of TOPS data file merging and nested sample generation process. 
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Sample Filters 


For the purpose of evaluating the effectiveness of TAPAS, exclusions to the analysis samples 
were imposed based on AFQT score, education level, service history, and component. 

AFQT Category 

The ASVAB is a multiple aptitude battery of tests administered by the MEPCOM. Most military 
applicants take the computer adaptive version of ASVAB (i.e., the CAT-ASVAB). Scores on the 
ASVAB tests are combined to create composite scores for use in selecting applicants into the Army 
and qualifying them for a MOS. The AFQT, the composite used for selecting applicants into the Army, 
comprises the Verbal Expression 5 (VE), Arithmetic Reasoning (AR), and Math Knowledge (MK) tests 
(AFQT = 2*VE + AR + MK). Applicants must meet a minimum AFQT score to be eligible to serve in 
the military, and the Services favor high-scoring applicants for enlistment. AFQT percentile scores are 
divided into the following categories: 6 

• Category I (93-99) 

• Category II (65-92) 

• Category IIIA (50-64) 

• Category IIIB (31-49) 

• Category IV (10-30) 

• Category V (1-9) 

AFQT Category V Soldiers are not eligible for enlistment. Category IV accessions are greatly 
restricted, some restriction is placed on accessing Category IIIB accessions, and priority is given 
to Category I-IIIA accessions. The Applicant Sample excludes Soldiers with an AFQT score of 
less than 10 (i.e., Category V; n = 11,488). 

For assignment, scores on the ASVAB tests are combined to form 10 Aptitude Area (AA) 
composites. An applicant must receive a minimum score on the MOS-relevant AA composite(s) to 
qualify for assignment to that MOS. For example, applicants must score a 95 in both the Electronics 
(EF) and Signal Communications (SC) AA composites to qualify as a Signal Support Specialist 
(25U). Descriptive statistics for the AFQT, ASVAB tests, and AA composites are reported in 
Appendix A. AFQT category frequencies are reported in Tables 2.1 and 2.2. 

Education Tier 

In the early 1980s, the Department of Defense initiated a detailed study of the relationship 
between educational credentials, other background characteristics, and adaptability for military 
service. The results supported a three-tier classification of educational credentials including: 


5 Verbal Expression is a scaled combination of the Word Knowledge (WK) and Paragraph Comprehension (PC) tests. 

6 For more information on ASVAB scoring, see the official website of the ASVAB, www.officialasvab.com. 
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Tier 1 - Primarily high school diploma and higher (e.g., individuals currently in high 
school or college, college graduates, adult/altemative diplomats, home school 
diplomats) 7 

Tier 2 - Primarily non-diploma graduate (e.g., GED certificants, vocational-technical 
certificants, non-traditional high school credential holders) 

Tier 3 - Non-high school graduate (i.e., individuals not currently attending high school and 
do not possess a high school diploma or alternate credential) 

Consistent with Army policy, which specifies that Soldiers classified as Tier 3 are ineligible for 
accession, the Applicant Sample excludes Tier 3 Soldiers and those with unknown values (n = 
9,977). 8 Subsequent analyses report results separately for Tier 1 and Tier 2 Soldiers. 

Service History 

Because the TOPS program is designed to predict first term Soldier performance, individuals 
with prior service history are excluded from the analysis samples (n = 11,443). 

Service Component 

The Applicant Sample includes Soldiers from all Army components - Regular Army (RA), U.S. 
Army Reserve (USAR), and U.S. Army National Guard (ARNG). For most analyses, Soldiers 
from all components are included. However, for analyses involving separation data, results are 
only presented for the Regular Army Soldiers. 

MOS 

Because the TAPAS is not used in the selection of Interpreters and Translators, 09L and 09C are 
excluded from the analysis samples (n = 1,027). 

Description of Analysis Samples 

Table 2.1 summarizes the full TAPAS sample by the key variables that were used to create the 
analysis samples. Among the 623,480 applicants in the total unfiltered sample, 573,146 (91.9%) 
met the criteria for the Applicant Sample (i.e., non-prior service, Education Tier 1 or 2, and 
minimum AFQT score of 10). A detailed breakout of background and demographic 
characteristics observed in the analysis samples appears in Table 2.2. 


7 In 2012, the Department of Defense announced that applicants who score 50 or higher on the AFQT and possess 
diplomas from home schools, virtual/distance learning, and adult/alternative schools will receive Tier 1 enlistment 
priority. 

8 Starting with the December 2013 TOPS data file, we reconfigured the data sources used to best capture a Soldier’s 
education tier status at the time of his or her accession. DMDC records now serve as the primary source of this 
information. As a result, figures for education tier reported in the current report differ from corresponding figures in 
previous reports. The differences are generally minor and do not impact the overall results. 
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Table 2.1. Full TAPAS Sample Characteristics 


Variables 

n 

% of Total Sample 
(N = 623,480) 

Education Tier 

Tier 1 

580,223 

93.1 

Tier 2 

33,280 

5.3 

Tier 3 

6,567 

1.1 

Unknown 

3,410 

0.5 

Prior Service 

Yes 

11,443 

1.8 

No 

612,037 

98.2 

Military Occupational Specialty 

1 IB/11C/11X/18X 

55,010 

8.8 

12B 

7,958 

1.3 

13M 

985 

0.2 

13P 

694 

0.1 

13R 

661 

0.1 

19D 

8,709 

1.4 

19K 

3,865 

0.6 

25B 

4,366 

0.7 

25N 

1216 

0.2 

25U 

6,150 

1.0 

31B 

14,818 

2.4 

42A 

9,444 

1.5 

68W 

16,865 

2.7 

88M 

16,976 

2.7 

91A 

701 

0.1 

91B 

17,244 

2.8 

91M 

1050 

0.2 

91P 

256 

0.0 

Other 

189,384 

30.4 

Unknown a 

267,128 

42.8 

AFQT Category b 

I 

35,335 

5.7 

II 

166,367 

26.7 

IIIA 

117,116 

18.8 

TUB 

198,787 

31.9 

IV 

94,267 

15.1 

V 

11,488 

1.8 

Unknown a 

120 

0.0 

Contract Status 

Signed 

373,530 

59.9 

Not signed 

249,950 

40.1 

Applicant Sample c 

573,146 

91.9 


a Generally, when the MOS or AFQT Category is unknown, it is either because the information was not yet available in the data 
sources on which the December 2014 data file was based or because the respondent did not access into the Army. 
b AFQT Categories IIIB and IV are oversampled. Values presented are not representative of Army accessions. 
c The Applicant Sample size is smaller than the total TAPAS sample because it is limited to non-prior service, Education Tier 1 
and 2, and AFQT > 10 applicants. 
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Table 2.2. Background and Demographic Characteristics of the TOPS Samples 



Applicant a 
n = 573,146 

Administrative 

Validation b 
n = 311,908 

IMT 

Validation c 

n = 27,372 

In-Unit 
V alidation 
n = 3,105 

d 

Characteristic 

n 

% 

n 

% 

n 

% 

N 

% 

Component 

Regular 

320,091 

55.8 

179,401 

57.5 

16,884 

61.7 

3,096 

99.7 

ARNG 

181,612 

31.7 

94,092 

30.2 

7,964 

29.1 

9 e 

0.3 

USAR 

71,443 

12.5 

38,415 

12.3 

2,524 

9.2 

— 

- 

Education Tier 

Tier 1 

541,719 

94.5 

299,429 

96.0 

26,304 

96.1 

3,006 

96.8 

Tier 2 

31,427 

5.5 

12,479 

4.0 

1,068 

3.9 

99 

3.2 

Military Occupational Specialty 
11B/11C/11X/18X 51,720 

9.0 

49,166 

15.8 

9,433 

34.5 

714 

23.0 

12B 

7,578 

1.3 

6,951 

2.2 

426 

1.6 

104 

3.3 

13M 

928 

0.2 

874 

0.3 

229 

0.8 

12 

0.4 

13P 

670 

0.1 

633 

0.2 

188 

0.7 

8 

0.3 

13R 

637 

0.1 

595 

0.2 

133 

0.5 

7 

0.2 

19D 

8,218 

1.4 

7,768 

2.5 

160 

0.6 

173 

5.6 

19K 

3,722 

0.6 

3,561 

1.1 

1,395 

5.1 

89 

2.9 

25 B 

4,145 

0.7 

3,815 

1.2 

911 

3.3 

24 

0.8 

25 N 

1,169 

0.2 

1127 

0.4 

143 

0.5 

16 

0.5 

25 U 

5,893 

1.0 

5,385 

1.7 

16 

0.1 

51 

1.6 

31B 

13,999 

2.4 

12,663 

4.1 

3,613 

13.2 

78 

2.5 

42A 

8,958 

1.6 

8,133 

2.6 

1,577 

5.8 

72 

2.3 

68W 

16,041 

2.8 

15,080 

4.8 

4,010 

14.7 

129 

4.2 

88M 

16,099 

2.8 

14,540 

4.7 

3,421 

12.5 

165 

5.3 

91A 

666 

0.1 

632 

0.2 

146 

0.5 

6 

0.2 

91B 

16,390 

2.9 

14,858 

4.8 

862 

3.1 

146 

4.7 

91M 

1,000 

0.2 

979 

0.3 

241 

0.9 

11 

0.4 

91P 

241 

0.0 

234 

0.1 

50 

0.2 

4 

0.1 

Other 

178,114 

31.1 

164,834 

52.8 

418 

1.5 

1,296 

41.7 

Unknown 

236,958 

41.3 

80 

0.0 

- 

- 

- 

- 

AFQT Category f 

I 

32,079 

5.6 

19,475 

6.2 

1,810 

6.6 

156 

5.0 

II 

154,631 

27.0 

95,840 

30.7 

9,733 

35.6 

874 

28.1 

BIA 

109,601 

19.1 

65,748 

21.1 

5,711 

20.9 

697 

22.4 

TUB 

188,293 

32.9 

114,026 

36.6 

8,831 

32.3 

1,224 

39.4 

IV 

88,542 

15.4 

16,819 

5.4 

1,287 

4.7 

154 

5.0 

Gender 

Female 

119,341 

20.8 

54,743 

17.6 

3,579 

13.1 

361 

11.6 

Male 

434,048 

75.7 

245,017 

78.6 

23,135 

84.5 

2,675 

86.2 

Missing 

19,757 

3.4 

12,148 

3.9 

658 

2.4 

69 

2.2 

Race 

African American 

130,858 

22.8 

64,398 

20.6 

4,272 

15.6 

662 

21.3 

American Indian 

4,568 

0.8 

2,372 

0.8 

221 

0.8 

18 

0.6 

Asian 

22,275 

3.9 

12,140 

3.9 

901 

3.3 

123 

4.0 

Hawaiian/Pacific 

2,013 

0.4 

1,124 

0.4 

124 

0.5 

14 

0.5 

Caucasian 

397,408 

69.3 

225,551 

72.3 

21,002 

76.7 

2,189 

70.5 

Multiple 

2,252 

0.4 

1,336 

0.4 

116 

0.4 

15 

0.5 

Declined to 

Answer/Missing 

13,772 

2.4 

4,987 

1.6 

736 

2.7 

84 

2.7 
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Table 2.2. (Continued) 


Characteristic 

Applicant a 
n = 573,146 

Administrative 

Validation b 
n = 311,908 

IMT 

Validation c 

n = 27,372 

In-Unit 

Validation d 
n = 3,105 

n 

% 

N 

% 

n 

% 

N 

% 

Ethnicity 









Hispanic/Latino 

88,480 

15.4 

46,444 

14.9 

3,501 

12.8 

420 

13.5 

Not Hispanic 

471,295 

82.2 

261,212 

83.7 

23,247 

84.9 

2,614 

84.2 

Declined to 









Answer/Missing 

13,371 

2.3 

4,252 

1.4 

624 

2.3 

71 

2.3 


a Limited to applicants who had no prior service, Education Tier 1 or 2, AFQT > 10; served as the core analysis sample. 
Additionally, 09L and 09C Soldiers were removed from all analyses. 

b Soldiers in Applicant Sample with at least one criterion record (i.e., schoolhouse, in-unit, ATRRS, RITMS, or attrition). 
c Soldiers in Applicant Sample with criterion data collected at schoolhouses. 
d Soldiers in Applicant Sample with criterion data collected in units. 

e We believe these Soldiers were on active duty when the in-unit data collections were taking place. 
f AFQT Categories IIIB and IV are oversampled. Values presented are not representative of Army accessions. 


Across all analysis samples, a majority of the Soldiers are Regular Army, Education Tier 1. Of 
the targeted MOS, 11B predominates, with nearly three times as many Soldiers as the next 
largest group (i.e., 91B). The least represented MOS include 91A, 91P, 13P and 13R Soldiers. 

The Administrative Validation Sample includes 311,908 Soldiers who meet all of the inclusion 
criteria for the TOPS Applicant Sample and also have at least one record in an administrative 
criterion data source (e.g., Army Training Requirements and Resources System [ATRRS], 
Resident Individual Training Management System [RITMS]). There are 68,512 Soldiers with IMT 
criterion data; however, only 27,372 were linked to an administrative TAP AS record and included in 
the IMT Validation Sample. Similarly, there are 7,310 Soldiers with in-unit data but only 3,105 of 
these Soldiers have matching TAP AS data and were included in the In-Unit Validation Sample. 
There are 465 Soldiers with a TAP AS record and both IMT and in-unit criterion data. 

There are two primary reasons for the diminution of sample sizes between the Applicant Sample and 
the Administrative Validation samples. First is the fact that many of the applicants did not access into 
the Army. Second, we rely on self-reported name and date of birth to match TAP AS records to the 
criterion data, which often results in unsuccessful matches. Further, fewer than half of the total 
number of Soldiers for whom we have IMT and in-unit criterion data are in the IMT and In-Unit 
Validation samples. In addition to cases lost due to unreliable reporting of the matching variables 
(name and date of birth), criterion testing started early in 2009 before TAP AS was being widely 
administered to applicants. 

Sample sizes reported in all subsequent chapters and appendices are generally smaller than the 
figures reported here because of further data filtering or disaggregation that occurs for each 
particular analysis. For example, predictor and criterion scores were determined to be valid if 
they passed multiple data quality screens intended to identify unmotivated responding. 

Additional screens are analysis specific and have not yet been applied to the descriptive analysis 
of the samples described in this chapter. Further, a relatively small number of Soldiers in the 
Applicant Sample (n = 1,528) were administered an early version of the TAPAS and were 
excluded from analyses because of conceptual dissimilarities with subsequent TAPAS forms. 


9 



Summary 


The TOPS analysis samples represent a combination of administrative, IMT, and in-unit data 
obtained from Soldiers, their supervisors and cadre, and archival sources at multiple points in 
time using a variety of data collection methods. The December 2014 full sample includes 
623,480 applicants who took the TAP AS; however, some of them did not access into the Army 
or were ineligible for inclusion in the analyses based on their education status, AFQT score, 
component, or service history. 

After excluding Education Tier 3, AFQT Category V, and prior service applicants from the full 
sample, the remaining 573,146 Soldiers were included in the TOPS Applicant Sample. This 
sample represents Soldiers who possess qualities that are most representative of applicants to the 
Army. A majority of the Soldiers included in the sample are listed as Regular Army, Education 
Tier 1; and are predominantly male, White and non-Hispanic. 

Additional analysis samples were created based on this initial sample; however, they include 
fewer Soldiers. Of the full Applicant Sample, 311,908 (54.4%) had a record in at least one of the 
administrative criterion data sources; 27,372 (4.8%) had IMT data collected from the 
schoolhouse and 3,105 (.54%) had in-unit criterion data. The applicant sample and validation 
samples were used in subsequent analyses presented in Chapter 4, 5, and 6 and associated 
appendixes. 
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CHAPTER 3: THE TAILORED ADAPTIVE PERSONALITY ASSESSMENT SYSTEM 

(TAPAS) 

Stephen Stark, O. Sasha Chernyshenko, Christopher Nye, and Fritz Drasgow 

(Drasgow Consulting Group) 

The purpose of this chapter is to describe the primary predictor measure being investigated in the 
TOPS IOT&E, the TAPAS (Drasgow et al., 2012; Stark et al., 2010). 

Description 

The TAPAS is a personality measurement tool originally developed by Drasgow Consulting 
Group (DCG) under the Army’s Small Business Innovation Research (SBIR) program. The 
system builds on the foundational work of the Assessment of Individual Motivation ([AIM]; 
White & Young, 1998) by incorporating features designed to promote resistance to faking and by 
measuring narrow personality constructs (i.e., facets) that are known to predict outcomes in work 
settings. The TAPAS uses methods from item response theory (IRT) to construct and score 
items. It can be administered in multiple formats: (a) as a fixed length, non-adaptive test where 
examinees respond to the same sequence of items or (b) as an adaptive test where each examinee 
responds to a unique sequence of items selected to maximize measurement accuracy for that 
specific examinee. 

The TAPAS uses an IRT model for multidimensional pairwise preference (MDPP) items (Stark, 
Chernyshenko, & Drasgow, 2005) as the basis for constructing, administering, and scoring 
personality tests that are designed to reduce response distortion (i.e., faking) and yield normative 
scores even with tests of high dimensionality (Stark, Chernyshenko, & Drasgow 2012). TAPAS 
items consist of pairs of personality statements for which a respondent’s task is to choose the one 
that is “more like me.” The two statements constituting each item are matched in terms of social 
desirability and statement location along trait continuum (extremity), and often represent 
different personality facets. This approach makes it more difficult for examinees to determine 
which answers are better from the Army’s perspective, and thus it is harder to “fake good” on all 
facets throughout the course of the test than it is with single-statement Likert-type personality 
items. Stark et al. (2014) reported small mean differences in scores of individuals who might be 
motivated to increase their scores (i.e., Army applicants who were told that their score might 
affect their enlistment eligibility) compared to individuals not so motivated (Air Force applicants 
who were asked to complete the TAPAS for research purposes only). In short, the TAPAS’ 
features make it more difficult for respondents to distort their responses to obtain more desirable 
scores. 

The use of an IRT model also greatly increases the flexibility of the assessment process. A 
variety of test versions can be constructed to measure personality facets that are relevant to 
specific work contexts, and the measures can be administered via paper-and-pencil or 
computerized formats. If test content specifications (i.e., test blueprints) are comparable across 
versions, the respective scores can be readily compared because the metric of the statement 
parameters has already been established by calibrating response data obtained from a base or 
reference group (e.g., Army recruits). The same principle applies to adaptive testing, wherein 
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each examinee receives a different set of items chosen specifically to reduce the error in his or 
her facet scores at points throughout the exam. Adaptive item selection enhances test security 
because there is less overlap across examinees in terms of the items presented. 

Another important feature of the TAPAS is that pools of statements representing over two dozen 
narrow personality facets are available. The initial TAPAS trait taxonomy was developed using 
the results of several large scale factor-analytic studies with the goal of identifying a 
comprehensive set of non-redundant narrow traits. Since then, additional facets have been added 
and these narrow traits, if necessary or desired, can be combined to form either the Big Five (the 
most common organization scheme for narrow personality traits) or any other number of broader 
traits (e.g., Integrity or Positive Core Self-Evaluations). This is advantageous for applied 
purposes because TAPAS versions can be created to fit a wide range of applications (both pre- 
and post-enlistment) and are not limited to a particular service branch or criterion. Selection of 
specific TAPAS facets can be guided by consulting the results of a meta-analytic study 
performed by DCG that mapped TAPAS facets to several important organizational criteria for 
military and civilian jobs (e.g., task proficiency, training performance, attrition) (Chernyshenko 
& Stark, 2007), as well as subsequent validation research. Table 3.1 presents the names of the 
TAPAS facets together with a description of a typical high scoring individual. 

Scoring details and the criterion-related validation work that led to the inclusion of TAPAS in 
the TOPS IOT&E can be found in the Expanded Enlistment Eligibility Metrics report (Knapp & 
Heffner, 2010) and in earlier evaluation reports in this series (e.g., Knapp & Heffner, 2011). 

Psychometric Properties of TAPAS Test Versions 

As part of the TOPS IOT&E, nine versions of the TAPAS have been administered (see Table 3.2). 
The different versions have allowed ARI to explore the value of alternative facets and to retire the 
statement pools that were exposed in research settings. Currently, MEPS testing uses a statement 
pool developed solely for use by ARI and other agencies authorized to use it (e.g., the other U.S. 
military services) 9 . All versions created in August 2011 or later use ARI-owned statement pools. In 
the present report, the validation analyses reported in Chapter 5 use all TAPAS versions except for 
the first one (13D-CAT) in which some of the dimensions are conceptually dissimilar from the same 
dimensions in later versions. 

As a test security measure, form equivalence information is provided upon request. Scores have 
been standardized within TAPAS versions to enable cross-version analyses. 


9 The Office of People Analytics (formerly Defense Manpower Data Center) own the operational TAPAS test. 
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Table 3.1. TAP AS Facets Names and Definitions 


Facet Name Brief Description 


Achievement 

High scoring individuals are seen as hard working, ambitious, confident, and 
resourceful. 

Adjustment 

High scoring individuals are well adjusted, worry free, and handle stress well. 

Adventure Seeking 

High scoring individuals enjoy participating in extreme sports and outdoor 
activities. 

Aesthetics 

High scoring individuals appreciate various forms of art and music and 
participate in art-related activities more than most people. 

Attention Seeking 

High scoring individuals tend to engage in behaviors that attract social 
attention. They are loud, loquacious, entertaining, and even boastful. 

Commitment to Serve 

High scoring individuals identify with the military and have a strong desire to 
serve their country. 

Consideration 

High scoring individuals are affectionate, compassionate, sensitive, and caring. 

Cooperation 

High scoring individuals are pleasant, trusting, cordial, non-critical, and easy to 
get along with. 

Courage 

High scoring individuals stand up to challenges and are not afraid to face 
dangerous situations. 

Curiosity 

High scoring individuals are inquisitive and perceptive; they are interested in 
learning new information. 

Dominance 

High scoring individuals are domineering, “take charge” and are often referred 
to by their peers as "natural leaders." 

Even Tempered 

High scoring individuals tend to be calm and stable. They don’t often exhibit 
anger, hostility, or aggression. 

Ingenuity 

High scoring individuals are inventive and can think "outside of the box." 

Intellectual Efficiency 

High scoring individuals believe they process information and make decisions 
quickly; they see themselves (and they may be perceived by others) as 
knowledgeable, astute, or intellectual. 

Non-Delinquency 

High scoring individuals tend to comply with rules, customs, norms, and 
expectations, and they tend not to challenge authority. 

Optimism 

High scoring individuals have a positive outlook on life and tend to experience 
joy and a sense of well-being. 

Order 

High scoring individuals tend to organize tasks and activities and desire to 
maintain neat and clean surroundings. 

Physical Conditioning 

High scoring individuals tend to engage in activities to maintain their physical 
fitness and are more likely participate in vigorous sports or exercise. 

Responsibility 

Table 3.1. (Continued) 

High scoring individuals are dependable, reliable, and make every effort to 
keep their promises. 
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Facet Name 


Brief Description 


Self Control High scoring individuals tend to be cautious, levelheaded, able to delay 

gratification, and patient. 

Selflessness High scoring individuals are generous with their time and resources. 

Situational Awareness High scoring individuals pay attention to their surroundings and rarely get lost 

or surprised. 

Sociability High scoring individuals tend to seek out and initiate social interactions. 

Team Orientation High scoring individuals prefer working in teams and make people work 

together better. 

Tolerance High scoring individuals are interested in other cultures and opinions that may 

differ from their own. They are willing to adapt to novel environments and 
situations. 

Virtue High scoring individuals strive to adhere to standards of honesty, morality, and 

“good Samaritan” behavior. 


Descriptive statistics, subgroup score comparisons, and intercorrelations of individual TAPAS 
scale scores and composite scores are provided in Appendix A. Also reported there are 
correlations of TAPAS scales with AFQT, ASVAB subtests, and Aptitude Area composites. 
Because most of the observed correlations between TAPAS scales and ASVAB subtests were in 
the -.20 to +.20 range, the two measures are judged to provide non-redundant information about 
applicants’ dispositions, which is advantageous in selection and classification contexts. 


Table 3.2. TAPAS Versions by Administration Date 


TAPAS Version 

Dates Administered 

# of Facets 

Adaptive 

# of Items 

13D-CAT 

May 4, 2009 to July 10, 2009 

13 

Yes 

104 

15D-Static 

July 2010 to August 2011 

15 

No 

120 

15D-CAT v4 

July 2010 to August 2011 

15 

Yes 

120 

15D-CAT v5 

August 2011 to September 2013 

15 

Yes 

120 

15D-CAT v7 

August 2011 to September 2013 

15 

Yes 

120 

15D-CAT v8 

August 2011 to September 2013 

15 

Yes 

120 

13D-CAT v9 

September 2013 - present 

13 

Yes 

120 

13D-CAT vlO 

September 2013 - present 

13 

Yes 

120 

13D-CAT vl 1 

September 2013 - present 

13 

Yes 

120 
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TAPAS Composites 


An initial Education Tier 1 performance screen was developed from the TAPAS-95s scales for the 
purpose of testing in an applicant setting (Allen et al., 2010). 10 This was accomplished by (a) 
identifying key criteria of most interest to the Army, (b) sorting these criteria into “can do” and 
“will do” categories (see below), and (c) selecting composite scales corresponding to the can do 
and will do criteria, taking into account both theoretical rationale and empirical results. Two unit- 
weighted TAPAS composites were initially developed: (a) Can-Do (for predicting technical 
training performance and completion) and (b) Will-Do (for predicting attrition and motivation- 
based performance). These composites were used operationally from March 2011 - September 
2013. 

A subsequent set of composites was developed by DCG and includes three regression-weighted 
scores: (a) Can-Do, (b) Will-Do, and (c) Adaptation (for predicting attrition). These scores 
became available for Army decision-making in September 2013. The specific facet scales 
comprising each TAPAS composite as well as composite construction are not publically 
available due to the operational nature of this measure. 

The criterion-related validation analyses in Chapter 5 use the new composite scores. Not all 
versions of the earlier TAPAS versions included the scales comprising the Can-Do and 
Adaptation composites. This is reflected in substantially smaller sample sizes for analyses 
involving the Can-Do composites. To maximize analysis sample sizes, scores on the Adaptation 
composite were computed using modified formulas for TAPAS versions 7 and 8. Scoring details 
and evidence of score equivalence across formulae is documented in a separately published ARI 
research note. 


Summary 

The purpose of this chapter was to describe the primary predictor measure being evaluated in the 
TOPS IOT&E. The TAPAS is unique among personality measures because it uses forced-choice 
pairwise items and IRT to promote resistance to faking. Promising initial validation research 
conducted as part of EEEM has been followed by additional research showing the validity of 
TAPAS in operational settings (Nye et al., 2012). 


10 TAPAS-95s was a paper-and-pencil, static version of the TAPAS used in the Army Class research. 
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CHAPTER 4: DESCRIPTION AND PSYCHOMETRIC PROPERTIES OF CRITERION 

MEASURES 


Matthew C. Reeder, Bethany H. Bynum, and D. Matthew Trippe (HumRRO) 

Criterion scores to validate the TAPAS were derived from measures administered for purposes 
of this research and from administrative records. The research measures included data provided 
by Soldiers in the form of job knowledge tests (JKTs) and a questionnaire measuring self- 
reported attitudes and performance (Army Life Questionnaire [ALQ]). Additionally, research 
measures included data provided by Soldiers’ cadre and supervisors through performance rating 
scales (PRS) created for research purposes. Criterion scores drawn from Soldiers’ administrative 
records included separation status (i.e., attrition), IMT completion, and IMT grades. Table 4.1 
provides a description of each of these measures. 


Table 4.1. Summary of IMT and In-Unit Criterion Measures 


Criterion Measure 

Description 

Soldier/ Cadre/ Supervisor Reported 

Job Knowledge Tests (JKT) 

The Warrior Tasks and Battle Drills (WTBD) JKT measures 
knowledge that is general to all enlisted Soldiers. MOS-specific JKTs 
measure Soldiers’ knowledge of basic facts, principles, and 
procedures required of Soldiers in training for a particular MOS. Each 
JKT includes a mix of item formats (e.g., multiple-choice, multiple- 
response, and rank order). 

Army Life Questionnaire (ALQ) 

The ALQ measures Soldiers’ self-reported attitudes and experiences in 
the Army. The IMT and in-unit versions are very similar. 

Performance Rating Scales (PRS) 

The IMT PRS measure Soldiers’ performance in two domains: 

(a) MOS-specific (e.g., learns preventive maintenance checks and 
services, learns to troubleshoot vehicle and equipment problems) and (b) 
Army-wide (e.g., exhibits effort, supports peers, demonstrates physical 
fitness). The IMT PRS are completed by training cadre. In-unit PRS 
cover Army-wide dimensions only and are completed by supervisors. 

Administrative 

Attrition 

Separation data are obtained on participating Soldiers beginning at 3- 
months and at regular 3-month intervals thereafter. Attrition data 
through 36 months were available for the current sample. 

Initial Military Training (IMT) Criteria 

These data provide information about whether Soldiers restarted IMT 
and for what reasons, the number of times Soldiers restarted training, 
graduation status, and final school grades for Soldiers in Advanced 
Individual Training AIT. 


In this chapter, we describe the criterion measures and composite scores, along with their 
distributional and psychometric properties. The descriptive statistics, as well as the correlations 
among the criteria and subgroup differences shown in Appendix B, are based on the Validation 
Sample (i.e., Education Tier 1 and 2, non-prior service, AFQT Category IV or above Soldiers 
with matching criterion data). Descriptive statistics and psychometric properties of the criterion 
measures for the full IMT and in-unit samples are reported in Appendix C. 
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Job Knowledge Tests (JKTs) 


There are multiple JKTs used in the current research. All participating Soldiers are given a 
generic JKT called the Warrior Tasks and Battle Drills (WTBD). Additionally, Soldiers in some 
MOS are given MOS-specific JKTs. Two such JKTs were developed for this research project, 
and all others (including the WTBD JKT) were developed through previous ARI research 
projects: Select21 (Collins, Lc, & Schantz, 2005) or Army Class (Moriarty, Campbell, Heffner, & 
Knapp, 2009). Currently, we have MOS-specific JKT data for the following jobs: Infantry (11B/C/X 
+ 18X), Armor (19K), Military Police (31B), Health Care Specialist (68W), Light Wheel Vehicle 
Mechanic (91B), Motor Transport Operator Soldiers (88M), and Human Resources Specialist 
(42A). Most of the JKT items are in a multiple-choice format with two to four response options. 
However, other formats, such as multiple-response (i.e., check all that apply), rank ordering, and 
matching are also used. The items use visual images to make them more realistic and reduce 
reading requirements for the test. 


A single, overall raw score was computed for each JKT by summing the total number of points 
Soldiers earned across the JKT items and computing a percent correct score based on the 
maximum number of points that could be obtained on each test. For the correlational analyses 
among criterion variables and criterion-related validity analyses, we converted the total raw 
scores to standardized scores (or --score) by standardizing the scores within each MOS. A JKT 
score was flagged and not included in analysis if the Soldier (a) omitted more than 10% of the 
assessment items, (b) took fewer than five minutes to complete the entire assessment, or (c) 
selected an implausible response to one of the careless responding items (Knapp et al., 2012). 
Table 4.2 lists the reliability estimates for the MOS-Specific JKTs and the WTBD JKT for the 
IMT and in-unit samples. 


Table 4.2. Reliability Estimates of the Job Knowledge Tests (JKTs) in the IMT and In-Unit 
Validation Samples 


Domain/JKT 

N 

A 

IMT 

MOS-Specific 



11B/C/X + 18X 

7,056 

.78 

19K 

1,172 

.79 

31B 

3,167 

.77 

42A 

1,178 

.76 

68W 

3,364 

.88 

88M 

2,554 

.76 

91B 

625 

.86 

WTBD (Army-Wide) a 

24,612 

.67 

In-Unit 

MOS-Specific 



11B/C/X + 18X 

624 

.68 

68W 

115 

.71 

88M 

140 

.79 

91B 

127 

.85 

WTBD (Army-Wide) a 

3,011 

.57 


Note, a = Coefficient Alpha. WTBD = Warrior Tasks and Battle Drills. In-unit statistics for MOS with fewer than 100 cases are 
not reported. 

"The WTBD JKTs are more heterogeneous in content than the MOS-specific JKTs, so would be expected to have lower alphas. 
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Table 4.3 lists the descriptive statistics for the IMT WTBD and MOS-specific JKTs by education 
tier and Table 4.4 lists the descriptive statistics for the in-unit WTBD and MOS-specific JKTs by 
education tier. 


Table 4.3. Descriptive Statistics for the Job Knowledge Tests (JKTs) in the IMT Validation 
Sample by Education Tier 


Domain/JKT 

n 

M 

SD 

Min 

Max 

fWTBD 

rAFQT 

Tier 1+2 (Combined) 

MOS-Specific 








11B/C/X + 18X 

7,056 

60.30 

10.50 

25.58 

86.96 

.58 

.44 

19K 

1,172 

62.31 

11.53 

23.08 

92.31 

.56 

.33 

31B 

3,167 

66.93 

8.70 

33.33 

91.26 

.50 

.46 

42A 

1,178 

53.91 

12.54 

16.67 

85.19 

.56 

.42 

68W 

3,364 

72.33 

10.43 

26.00 

92.39 

.51 

.27 

88M 

2,554 

63.15 

9.81 

31.94 

88.89 

.56 

.41 

91B 

625 

58.63 

12.04 

27.37 

90.72 

.49 

.30 

All MOS Combined a 

19,116 

63.57 

11.56 

16.67 

92.39 

.53 

.36 

WTBD (Army-Wide) 

24,612 

63.56 

12.39 

6.45 

97.30 


.43 

Tier 1 

MOS-Specific 








11B/C/X + 18X 

6,742 

60.33 

10.49 

25.58 

86.96 

.58 

.44 

19K 

1,134 

62.33 

11.49 

23.08 

86.15 

.55 

.33 

31B 

3,078 

66.87 

8.70 

33.33 

91.26 

.50 

.46 

42A 

1,151 

53.92 

12.56 

16.67 

85.19 

.56 

.42 

68W 

3,250 

72.36 

10.45 

26.00 

92.39 

.51 

.27 

88M 

2,442 

63.12 

9.81 

31.94 

88.89 

.56 

.41 

91B 

594 

58.47 

11.93 

27.37 

90.72 

.48 

.32 

All MOS Combined a 

18,391 

63.58 

11.56 

16.67 

92.39 

.53 

.36 

WTBD (Army-Wide) 

23,643 

63.54 

12.41 

6.45 

97.30 


.43 

Tier 2 

MOS-Specific 








11B/C/X + 18X 

314 

59.77 

10.73 

26.09 

86.96 

.55 

.30 

68W 

114 

71.57 

9.84 

33.70 

84.78 

.45 

.23 

88M 

112 

63.92 

9.90 

34.72 

83.33 

.61 

.45 

All MOS Combined a 

725 

63.36 

11.59 

26.09 

92.31 

.54 

.30 

WTBD (Army-Wide) 

969 

64.11 

11.88 

16.13 

93.55 


.33 


Note. M s, SDs . Min, and Max reflect percent correct. WTBD = Warrior Tasks and Battle Drills. rwrsD = correlation with WTBD 
JKT scores. rAFQT = correlation with AFQT scores. Statistics based on fewer than 100 cases are not reported. All correlations are 
statistically significant (p < .05, one-tailed). 
a Includes 11B/C/X + 18X, 19K. 31B, 42A, 68W, 88M, and 91B. 
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Table 4.4. Descriptive Statistics for Job Knowledge Tests (JKTs) in the In-Unit Validation 
Sample by Education Tier 


Domain/JKT 

n 

M 

SD 

Min 

Max 

rwTBD 

rAFQT 

Tier 1+2 (Combined) 

MOS-Specific 








11B/C/X + 18X 

624 

61.64 

8.44 

24.74 

84.51 

.52 

.44 

68W 

115 

71.76 

7.38 

36.79 

88.68 

.54 

.40 

88M 

140 

64.15 

9.45 

35.64 

85.15 

.49 

.56 

91B 

127 

64.18 

10.93 

35.09 

85.26 

.34 

.37 

All MOS Combined a 

1,201 

63.81 

10.31 

24.74 

92.59 

.46 

.41 

WTBD Army Wide 

3,011 

63.70 

10.97 

19.44 

96.15 


.45 

Tier 1 

MOS-Specific 








11B/C/X + 18X 

602 

61.73 

8.37 

24.74 

84.51 

.52 

.45 

68W 

114 

71.73 

7.40 

36.79 

88.68 

.54 

.40 

88M 

137 

64.22 

9.51 

35.64 

85.15 

.48 

.55 

91B 

124 

63.95 

10.91 

35.09 

85.26 

.33 

.37 

All MOS Combined a 

1,163 

63.81 

10.28 

24.74 

92.59 

Al 

.41 

WTBD Army Wide 

2,916 

63.69 

10.96 

19.44 

96.15 


.45 


Note. Ms, SDs, Min, and Max reflect percent correct. WTBD = Warrior Tasks and Battle Drills, twtbd = correlation with 
WTBD JKT scores, tafqt = correlation with AFQT scores. Results based on fewer than 100 cases are not reported. Tier 2 
results are not reported because sample sizes are less than 100 for all variables. All correlations are statistically significant (p 
< .05, one-tailed). 

a Includes 11B/C/X + 18X, 19K, 31B. 42A, 68W, 88M, and 91B. 


Performance Rating Scales (PRS) 

The PRS, l ik e the JKTs, also were adapted from or based on previous research (see Moriarty et al., 
2009 for details). The IMT and in-unit PRS are fairly different, so they will be described separately. 

IMTPRS 

The IMT PRS target two domains of Soldier performance requirements: (a) Army-wide and (b) 
MOS-specific. The IMT PRS were completed by cadre members (drill sergeants, trainers) of 
participating Soldiers. 

Over the course of the TOPS IOT&E, two versions of the IMT PRS were administered. Early 
IOT&E evaluations noted low interrater reliability estimates for the PRS (Moriarty & Bynum, 2011). 
Accordingly, several changes were made to the IMT instruments in an attempt to improve their 
psychometric characteristics. First, the number of scales for the Army-wide PRS was reduced from 
eight to five, paralleling the five scores generated from the original scales (Sparks & Peddie, 2013). 
No changes were made to the MOS-specific PRS scales; the number of scales ranged from five to 
nine, and a composite score was computed by averaging ratings across the individual scales for each 
MOS. Second, the rating format for both the Army-wide and MOS-specific PRS were changed from 
a 7-point behaviorally anchored rating scale (BARS) to a 5-point relative format with options ranging 


19 




from 1 (Among the Weakest) to 5 (Among the Best). All IMT PRS results are based on data from 
both the initial and revised PRS, and are expressed on a 5-point scale. 11 Finally, cadre members also 
indicated their opportunity to observe each Soldier being rated using a 4-point “familiarity'’ rating 
option. The initial PRS used a 3-point familiarity rating option. This was changed to a 4-point rating 
option to enable raters to more clearly indicate their ability to judge each Soldier’s performance. 

Table 4.5 summarizes the descriptive statistics for IMT PRS by education tier. A Soldier’s PRS 
ratings were not included in the analyses if the rater (a) indicated he or she had little opportunity 
to observe this Soldier, (b) omitted more than 10% of the assessment items, (c) indicated that he 
or she had not observed the Soldier on more than 50% of the dimensions, or (d) engaged in “flat 
responding”—that is, if the rater rated 10 or more Soldiers on a particular scale and 90% or more 
of those rating profiles were the same. Mean ratings were above the mid-point, a consistent 
finding in prior Army research (e.g., Campbell & Knapp, 2001; Knapp & Tremble, 2007; 
Moriarty & Bynum, 2011). The IMT PRS were also highly intercorrelated (see Appendix B). 


Table 4.5. Descriptive Statistics for the Performance Rating Scales (PRS) in the IMT 
Validation Sample by Education Tier 


Domain/PRS 

n 

M 

SD 

Tier 1 + Tier 2 (Combined) 

Army-Wide 




Adjustment to the Army 

7,642 

3.45 

0.97 

Effort & Personal Discipline 

7,645 

3.29 

0.96 

MOS Qualification Knowledge 

7,065 

3.40 

0.92 

Physical Fitness & Bearing 

7,630 

3.34 

0.96 

Working with Others 

7,607 

3.31 

0.96 

Overall Performance 

7,571 

3.55 

0.86 

MOS-Specific 




11B/C/X + 18X 

1,752 

3.22 

0.83 

19K 

399 

3.36 

0.72 

31B 

1,158 

3.32 

0.74 

42A 

362 

3.71 

0.68 

68W 

881 

3.08 

0.90 

88M 

122 

2.87 

0.78 

All MOS Combined a 

4,742 

3.26 

0.82 

Tier 1 

Army-Wide 




Adjustment to the Army 

7,345 

3.46 

0.97 

Effort & Personal Discipline 

7,348 

3.30 

0.96 

MOS Qualification Knowledge 

6,785 

3.41 

0.92 

Physical Fitness & Bearing 

7,333 

3.34 

0.96 

Working with Others 

7,314 

3.31 

0.96 

Overall Performance 

7,277 

3.56 

0.85 


11 The initial rating scale was converted from a 7-point scale to a 5-point scale by identifying meaningful cuts along 
the 7-point scale and comparing percentiles of the initial PRS to the new PRS to ensure the cuts points produced 
consistent percentiles in each group. The following conversions were used: 1.00-2.99 = 1; 3.00-4.99 = 2; 5.00-5.99 = 
3; 6.00-6.99 = 4; 7.00 = 5. 
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Table 4.5. (Continued) 


Domain/PRS 

n 

M 

SD 

MOS-Specific 

11B/C/X + 18X 

1.672 

3.23 

0.83 

19K 

386 

3.36 

0.73 

31B 

1,129 

3.32 

0.74 

42A 

354 

3.71 

0.68 

68W 

848 

3.09 

0.90 

88M 

116 

2.88 

0.77 

All MOS Combined a 

4,572 

3.26 

0.82 


Tier 2 



Army-Wide 

Adjustment to the Army 

297 

3.29 

0.98 

Effort & Personal Discipline 

297 

3.15 

0.98 

MOS Qualification Knowledge 

280 

3.31 

0.86 

Physical Fitness & Bearing 

297 

3.15 

0.96 

Working with Others 

293 

3.24 

0.99 

Overall Performance 

294 

3.35 

0.91 

MOS-Specific 

All MOS Combined a 

170 

3.10 

0.76 


Note. Ratings on PRS range from 1 and 5. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little 
opportunity to observe this Soldier”) were excluded from analyses. 
a Includes 11B/C/X+ 18X. 1 IB, 19K, 31B, 42A, 68W, 88M, and91B. 


In-Unit PRS 

The in-unit PRS only target Army-wide dimensions of performance (i.e., there are no MOS-specific 
in-unit PRS) and include 13 performance dimensions, plus a Leadership Potential scale (see Table 
4.6). One scale with poor psychometric properties was replaced in 2011 with the Adjustment to 
Army Life scale, comparable to the corresponding IMT scale. Ratings on several of the individual 
scales were combined to form four PRS composites and three scales were left as single-item 
dimensions. Cronbach’s alpha coefficients for the in-unit PRS composite scales are reported in Table 
4.6. The in-unit PRS have consistently employed the 7-point BARS format used for the initial IMT 
scales. The revised 4-point “familiarity'’ scale used in the new IMT PRS also is used with the in-unit 
PRS. The majority of Soldiers in units were rated by only one supervisor, so interrater reliability 
estimates were not calculated. Table 4.7 reports the basic descriptive statistics for the in-unit Army¬ 
wide PRS by performance domain and education tier. 
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Table 4.6. In-Unit Army-Wide Performance Rating Scale Dimensions and Composite Scores 


In-Unit Rating Composites 

a 

Can Do 

.91 

Performing Core Warrior Tasks 

Performing MOS-Speciftc Tasks 

Processing Information 

Solving Problems 


Effort & Personal Discipline 

.80 

Exhibiting Effort 

Exhibiting Personal Discipline 


Working with Others 

.69 

Communicating with Others 

Contributing to the Team 


Self-Management 

.79 

Following Safety Procedures 

Developing Own Skills 

Managing Personal Matters 


In-Unit Rating Single item Dimensions 

Adjustment to Army Life 

Physical Fitness and Bearing 

Overall Leadership Potential Rating 


Note. Of the seven performance ratings used in analyses, four are composites of multiple dimensions and three are single 
dimension ratings. 


Table 4.7. Descriptive Statistics for Army-Wide Performance Rating Scales (PRS) in the In- 
Unit Validation Sample 


PRS Dimensions/Composites 

n 

M 

SD 

Tier 1 + Tier 2 (Combined) 

Can Do a 

2,457 

4.91 

1.32 

Effort & Personal Discipline a 

2,455 

5.23 

1.39 

Physical Fitness & Bearing 

2,445 

5.32 

1.57 

Self-Management a 

2,444 

5.31 

1.16 

Working with Others a 

2,456 

5.31 

1.25 

Adjustment to Army Life 

2,220 

5.31 

1.56 

Overall Leadership Potential 

2,393 

4.78 

1.71 

Tier 1 

Can Do a 

2,375 

4.91 

1.31 

Effort & Personal Discipline a 

2,373 

5.24 

1.38 

Physical Fitness & Bearing 

2,364 

5.33 

1.57 

Self-Management a 

2,364 

5.32 

1.16 

Working with Others a 

2,374 

5.32 

1.25 

Adjustment to Army Life 

2,144 

5.31 

1.56 

Overall Leadership Potential 

2,314 

4.78 

1.70 


Note. Ratings on PRS range from 1 and 7. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to 
observe this Soldier”) were excluded from analyses. Tier 2 results are not reported because sample sizes are less than 100 for all PRS. 
a Ratings composites comprise two or more Army-wide PRS. 
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Army Life Questionnaire (ALQ) 


The ALQ was designed to measure Soldiers’ self-reported attitudes and experiences in the Army. 
Earlier forms of the training and in-unit versions of the ALQ (Van Iddekinge, Putka, & Sager, 2005) 
were modified slightly for use in the TOPS IOT&E. The ALQ includes scales that cover (a) Soldiers’ 
commitment and retention-related attitudes and (b) Soldiers’ performance and adjustment. The ALQ 
scales use several different formats. The Army Physical Litness Test (APLT) score is a write-in 
single item. Training Achievements, Training Lailures, (both of which appear only on the IMT 
version of the ALQ), and Disciplinary Incidents are simply a count of the “yes” responses to 
associated items. The remaining scales (see Table 4.8) are composed of Likert-type response scales 
and are scored by computing the mean of the constituent item scores. Most scales appear on both the 
IMT and in-unit versions of the scales, though the IMT version has two unique L ikert-based scales 
(i.e., Normative Commitment and Army Life Adjustment) and the in-unit version has one unique 
Likert-based scale (i.e., MOS satisfaction). 

ALQ data were flagged as unusable if the Soldier (a) omitted more than 10% of the assessment 
items, (b) took fewer than five minutes to complete the entire assessment, or (c) chose an implausible 
response to the careless responding item. Tables 4.9 and 4.10 summarize the descriptive statistics for 
the ALQ scales by education tier for the IMT and in-unit samples, respectively. 
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Table 4.8. Army Life Questionnaire (ALQ) Likert-Type Scales and Reliability Estimates 


Scale Name 

Description 

Number of 
Items 

Example Item 

Likert Scale Anchors 

IMT a 

In-Unit a 

Affective 

Commitment 

Measures Soldiers’ emotional 
attachment to the Army. 

7 

I feel like I am part of the Army 
‘family.’ 

1 (strongly disagree) to 5 (strongly 
agree) 

.86 

.88 

Normative 
Commitment a 

Measures Soldiers’ feelings of 
obligation toward staying in the 
Army until the end of their 
current term of service. 

5 

I would feel guilty if I left the 
Army before the end of my 
current term of service. 

1 (strongly disagree) to 5 (strongly 
agree) 

.78 


Career Intentions 

Measures Soldiers’ intentions to 
reenlist and to make the Army a 
career. 

3 

How likely is it that you will 
make the Army a career? 

Varies by item: 1 (strongly disagree) 
to 5 (strongly agree); 1 (not at all 
confident) to 5 (extremely 
confident); 1 (extremely unlikely) to 

5 (extremely likely) 

.91 

.93 

Reenlistment 

Intentions 

Measures Soldiers’ intention to 
reenlist in the Army. 

4 

How likely is it that you will 
leave the Army after completing 
your current term of service? 

1 (strongly disagree) to 5 (strongly 
agree) 

.83 

.81 

Attrition Cognitions 

Measures the degree to which 
Soldiers think about attriting 
before the end of their first term. 

4 

How likely is it that you will 
complete your current term of 
service? 

Varies by item: 1 (strongly disagree) 
to 5 (strongly agree); 1 (never) to 5 
(very often) 

.75 

.80 

Army Life 
Adjustment a 

Measures Soldiers’ transition 
from civilian to Army life. 

9 

Looking back, I was not 
prepared for the challenges of 
training in the Army. 

1 (strongly disagree) to 5 (strongly 
agree) 

.87 


MOS Fit 

Measures Soldiers’ perceived fit 
with their MOS. 

9 

My MOS provides the right 
amount of challenge for me. 

1 (strongly disagree) to 5 (strongly 
agree) 

.92 

.93 

Army Fit b 

Measures Soldiers’ perceived fit 
with the Army. 

8 

The Army is a good match for 
me. 

1 (strongly disagree) to 5 (strongly 
agree) 

.86 

.81 

MOS Satisfaction c 

Measures Soldiers’ satisfaction 
with their MOS. 

9 

My MOS allows me to perform 
the kind of work I want to do. 

1 (strongly disagree) to 5 (strongly 
agree) 


.92 


Note, a = coefficient alpha. 
a Appears only on the IMT ALQ. 
b Scale has six items on the in-unit ALQ. 
c Appears only on the in-unit ALQ. 



Table 4.9. Descriptive Statistics for the Army Life Questionnaire (ALQ) in the IMT Validation 
Sample by Education Tier 


Domain/Scale 

n 

M 

SD 

Tier 1 + Tier 2 (Combined) 

Retention 




Army Career Intentions 

25,884 

3.20 

1.09 

Affective Commitment 

25,884 

3.90 

0.67 

Army Fit 

25,884 

4.09 

0.60 

Army Reenlistment Intentions 

25,884 

3.49 

0.95 

Attrition Cognition 

25,884 

1.51 

0.59 

MOS Fit 

25,884 

3.76 

0.84 

Army Life Adjustment 

25,884 

4.09 

0.66 

Normative Commitment 

25,884 

4.18 

0.69 

Achievement/Performance 




Disciplinary Incidents (#) 

24,204 

0.29 

0.63 

Disciplinary Incidents (Y/N) 

24,204 

0.22 

0.41 

APFT Score 

25,161 

253.01 

28.10 

Training Achievement (#) 

25,873 

0.40 

0.61 

Training Failures (#) a 

25,199 

0.08 

0.29 

Tier 1 

Retention 




Army Career Intentions 

24,873 

3.19 

1.09 

Affective Commitment 

24,873 

3.89 

0.67 

Army Fit 

24,873 

4.09 

0.59 

Army Reenlistment Intentions 

24,873 

3.49 

0.95 

Attrition Cognition 

24,873 

1.51 

0.59 

MOS Fit 

24,873 

3.75 

0.84 

Army Life Adjustment 

24,873 

4.09 

0.66 

Normative Commitment 

24,873 

4.17 

0.69 

Achievement/Performance 




Disciplinary Incidents (#) 

23,241 

0.29 

0.63 

Disciplinary Incidents (Y/N) 

23,241 

0.22 

0.41 

APFT Score 

24,187 

253.27 

28.08 

Training Achievement (#) 

24,862 

0.40 

0.61 

Training Failures (#) a 

24,219 

0.08 

0.29 

Tier 2 

Retention 




Army Career Intentions 

1,011 

3.42 

1.08 

Affective Commitment 

1,011 

4.02 

0.65 

Army Fit 

1,011 

4.16 

0.60 

Army Reenlistment Intentions 

1,011 

3.63 

0.94 

Attrition Cognition 

1,011 

1.46 

0.57 

MOS Fit 

1,011 

3.81 

0.82 

Army Life Adjustment 

1,011 

4.13 

0.65 

Normative Commitment 

1,011 

4.27 

0.64 

Achievement/Performance 




Disciplinary Incidents (#) 

963 

0.35 

0.73 

Disciplinary Incidents (Y/N) 

963 

0.25 

0.43 

APFT Score (180-300) 

974 

246.65 

28.04 

Training Achievement (#) 

1,011 

0.36 

0.58 

Training Failures (#) a 

980 

0.08 

0.31 


d Training Failures (#) is based on the total number of affirmative responses to whether a Soldier restarted from Basic Combat 
Training (BCT) or One Station Unit Training (OSUT) or whether a Soldier repeated a block or module at AIT or OSUT. 
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Table 4.10. Descriptive Statistics for the Army Life Questionnaire (ALQ) in the In-Unit 
Validation Sample by Education Tier 


Domain/Setting/Scale 

n 

M 

SD 

Tier 1 + Tier 2 (Combined) 

Retention 




Army Career Intentions 

3,060 

2.59 

1.19 

Affective Commitment 

3,060 

3.54 

0.80 

Army Fit 

3,060 

3.87 

0.71 

Army Reenlistment Intentions 

3,060 

2.96 

1.18 

Attrition Cognition 

3,060 

1.72 

0.76 

MOS Fit 

3,060 

3.24 

0.93 

MOS Satisfaction 

3,060 

3.51 

0.90 

Achievement/Performance 




Disciplinary Incidents (#) 

3,060 

0.41 

0.87 

Disciplinary Incidents (Y/N) 

3,060 

0.25 

0.44 

APFT Score 

2,932 

253.13 

28.14 

Tier 1 

Commitment & Fit 




Army Career Intentions 

2,962 

2.58 

1.19 

Affective Commitment 

2,962 

3.54 

0.80 

Army Fit 

2,962 

3.86 

0.71 

Army Reenlistment Intentions 

2,962 

2.95 

1.17 

Attrition Cognition 

2,962 

1.72 

0.76 

MOS Fit 

2,962 

3.24 

0.93 

MOS Satisfaction 

2,962 

3.51 

0.90 

Achievement/Performance 




Disciplinary Incidents (#) 

2,962 

0.40 

0.85 

Disciplinary Incidents (Y/N) 

2,962 

0.25 

0.44 

APFT Score 

2,840 

253.18 

28.20 


Note. Tier 2 results are not reported because sample sizes are less than 100 for all ALQ scales. 


Administrative Criteria 


Attrition 

Attrition is a broad category that encompasses involuntary and voluntary separations for a 
variety of reasons (e.g., underage enlistment, conduct, family concerns, drugs or alcohol, 
performance, physical standards or weight, mental disorder, or violations of the Uniform Code of 
Military Justice [UCMJ]). The reason for separation was determined by the Soldiers’ Separation 
Program Designator (SPD) code. Soldiers who left the Army for reasons outside of their or the 
Army's control (e.g., death or serious injury incurred while performing one's duties) were 
excluded from our analyses. Separation data are reported for regular Army Soldiers only. The 
current analyses cover attrition through 36 months of service. Table 4.11 summarizes the basic 
descriptive statistics for attrition by education tier. 
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AIT Grade 


Soldiers’ final AIT course grades were extracted from RITMS (Resident Individual Training 
Management System). Final grades from One Station Unit Training (OSUT) courses were 
excluded from the data file because the variance in the grades was highly restricted or based on a 
pass-fail metric that was redundant with the data from ATRRS (Army Training Requirements 
and Resources System). Final AIT Grade represents the cumulative grade across all courses 
administratively recorded for the Soldier. 12 A standardized version of Final AIT Grade was 
computed by standardizing each course grade for courses with 15 or more Soldiers. Table 4.12 
summarizes the distribution of Final AIT Grade by education tier. 

Training Restarts 

Soldiers’ IMT completion status and whether they graduated from IMT with training restarts or 
training failures were extracted from ATRRS. Training restarts identify Soldiers with at least one 
restart (i.e., must begin training again) during IMT. Training failures identify Soldiers that 
graduated IMT with at least one failure (i.e., failed a component of training). Failures are further 
divided into failures that were due to academic reasons versus those that were due to pejorative 
reasons. Soldiers who had not had an opportunity to complete their IMT at the time data were 
extracted were excluded from analyses. Table 4.12 presents the base rates of Soldiers with at 
least one training restart or training failure during IMT. 

Criterion Composites 

A number of the criterion scales measure similar underlying constructs. Composites of these 
criterion scales were developed to reduce the number of criteria used to validate the TAPAS and 
simplify the interpretation of results, without sacrificing information. The four composites of 
Overall Performance, Commitment & Fit, Retention Cognitions, and Knowledge & Skill were 
constructed using theoretical rationale and examined using confirmatory factor analysis (CFA) 
(Bynum & Beatty, 2014). Can Do Performance and Will Do Performance composites were 
constructed using rational judgment, exploratory factor analyses (EFA), and confirmatory factor 
analysis (CFA), and were intended to encapsulate performance criteria associated with the ability 
to do the job and the motivation to consistently perform well, respectively (as referenced in 
Chapter 3). Table 4.13 lists the IMT and in-unit criterion composites, the scales included in each 
composite, and a brief description of how the composite was constructed. Descriptive statistics for 
the IMT and in-unit criterion composites are shown in Table 4.14. All of the composites were 
included in the validation analyses. 


12 In the rare instance where a Soldier has more than one administratively recorded AIT course grade, scores are 
averaged across courses for that Soldier. 
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Table 4.11. Base Rates for Attrition Criteria for Regular Army Soldiers in the Validation Sample by Education Tier 



Tier 1 + Tier 2 (Combined) 


Tier 1 



Tier 2 


Cumulative Attrition 

n 

flAttrit 

%Attrit 

n 

nAttrit 

%Attrit 

n 

nAttrit 

%Attrit 

6-Month 

167,037 

17,739 

10.6 

161,197 

16,866 

10.5 

5,840 

873 

14.9 

12-Month 

146,413 

19,576 

13.4 

142,198 

18,817 

13.2 

4,215 

759 

18.0 

24-Month 

96,012 

18,183 

18.9 

92,389 

17,229 

18.6 

3,623 

954 

26.3 

36-Month 

52,141 

13,208 

25.3 

50,610 

12,656 

25.0 

1,531 

552 

36.1 


Note, n = number of Soldiers with attrition data at the time data were extracted. nAttrit = number of Soldiers who attrited at the specified months of service. %mim = percentage of 
Soldiers who attrited through the specified months of service [(nAttrit In) x 100], 


Table 4.12. Base Rates or Descriptive Statistics for Administrative IMT Criteria in the Validation Sample 


Restarted Initial Military Training (IMT) 

Tier 1 + Tier 2 (Combined) 


Tier 1 



Tier 2 


n a 

nRestarted 

%Restarted 

n a 

nRestarted 

%Restarted 

n a 

nRestarted 

%Restarted 

IMT Restarts 

307,946 

14,943 

4.9 

295,585 

14,281 

4.8 

12,361 

662 

5.4 

IMT Failures 

184,945 

24,825 

13.4 

177,580 

23,527 

13.2 

7,365 

1,298 

17.6 

For Pejorative Reasons 

182,728 

22,492 

12.3 

175,465 

21,300 

12.1 

7,263 

1,192 

16.4 

For Academic Reasons 

178,526 

18,388 

10.3 

171,623 

17,554 

10.2 

6,903 

834 

12.1 

Final AIT School Grades 

n b 

M 

SD 

n b 

M 

SD 

n h 

M 

SD 

Overall Average (Unstandardized) 

42,129 

91.67 

8.19 

40,269 

91.68 

8.21 

1,860 

91.61 

7.72 

Overall Average (Standardized within Course) 

41,827 

0.05 

0.80 

39,978 

0.06 

0.80 

1,849 

-0.03 

0.81 


Note, n d — number of Soldiers with IMT data at the time data were extracted. nRestarted = number of Soldiers who restarted at least once during IMT. %Restaned = percentage of 
Soldiers who restarted at least once during IMT [{nRestarted In) x 100], Standardization excludes MOS courses with insufficient sample size (n < 15). n b = number of Soldiers with 
AIT school grade data at time data were extracted. 



Table 4.13. IMT and In-Unit Criterion Scores 


IMT 



Criterion Score 

Scales 

Description 

Overall Performance 

PRS: Army Adjustment 

PRS: Effort and Discipline 

PRS: MOS Qualification 

PRS: Physical Fitness 

PRS: Working with Others 

PRS: MOS Specific 

General effort/ motivation criterion. Scales 
are averaged to form the composite. 

Commitment & Fit 

ALQ: Affective Commitment 

ALQ: Normative Commitment 

ALQ: General MOS Fit 

ALQ: Needs Supplies Army Fit 

General commitment to and fit with the 

Army. Scales are averaged to form the 
composite. 

Retention Cognitions 

ALQ: Army Career Intentions 

ALQ: Army Re-enlistment 

ALQ: Attrition Cognition 

General intentions of continuance in the 

Army. Scales are averaged to form the 
composite. 

Knowledge & Skill 

WTBD JKT 

MOS JKT 

AIT Grade 

WTBD JKT and MOS JKT are averaged to 
form an overall knowledge/skill composite. For 
those that do not have an MOS JKT score, AIT 
grade is substituted. 

Can Do Performance 

Army-Wide JKT 

MOS JKT 

Total score of WTBD JKT and MOS JKT 

Will Do Performance 

Average Army-Wide PRS a 
MOS-Speciftc PRS 

APLT Score 

Average ALQ b 

Training Achievement 

Training Failures (#) 

Disciplinary Incidents (#) 

The seven scales are standardized and then 
summed to produce an overall will do 
performance score. 

In-Unit 

Overall Performance 

PRS: Can Do 

PRS: Effort and Personal Discipline 
PRS: Working with Others 

PRS: Self-Management 

PRS: Physical Fitness and Bearing 

General effort/ motivation criterion. Scales 
are averaged to form the composite. 

Commitment & Fit 

ALQ: Affective Commitment 

ALQ: General MOS Fit 

ALQ: Needs Supplies Army Fit 

General commitment to and fit with the 

Army. Scales are averaged to form the 
composite. 

Retention Cognitions 

ALQ: Army Career Intentions 

ALQ: Army Re-enlistment 

ALQ: Attrition Cognition 

General intentions of continuance in the 

Army. Scales are averaged to form the 
composite. 

Knowledge & Skill 

WTBD JKT 

MOS JKT 

WTBD JKT and MOS JKT are averaged to 
form an overall knowledge/skill composite. 

For those that do not have MOS JKT, only 
WTBD JKT scores are used. 


a Army-Wide PRS scales included in the average: Army Adjustment, Effort and Discipline, MOS Qualification, Physical Fitness, 
Working with Others, and Overall Performance. 

b ALQ scales included in the average: Affective Commitment, Normative Commitment, Career Intentions, Re-enlistment 
Intentions, Attrition Cognition, Army Life Adjustment, and MOS Fit. 
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Table 4.14. Descriptive Statistics for Criterion Composites in the IMT and In-Unit Validation 
Samples by Education Tier 


Domain/Measure 

n 

M 

SD 

Min 

Max 

Tier 1 + Tier 2 (Combined) 

IMT 






Overall Performance 

7,067 

3.38 

0.78 

1.00 

5.00 

Commitment & Fit 

25,884 

3.98 

0.58 

1.00 

5.00 

Retention Cognitions 

25,884 

2.73 

0.58 

1.00 

4.33 

Knowledge & Skill 11 

19,116 

0.03 

0.86 

-3.71 

2.27 

Can Do Performance a 

24,812 

-0.05 

1.61 

-7.42 

4.53 

Will Do Performance a 

3,859 

0.23 

3.05 

-14.11 

8.61 

In-Unit 






Overall Performance 

2,450 

5.23 

1.19 

1.00 

7.00 

Commitment & Fit 

3,060 

3.55 

0.68 

1.22 

5.00 

Retention Cognitions 

3,060 

2.42 

0.67 

1.00 

4.14 

Knowledge & Skill 11 

3,019 

-0.04 

0.95 

-4.22 

2.29 

Tier 1 

IMT 






Overall Performance 

6,787 

3.39 

0.78 

1.00 

5.00 

Commitment & Fit 

24,873 

3.98 

0.58 

1.00 

5.00 

Retention Cognitions 

24,873 

2.73 

0.58 

1.00 

4.33 

Knowledge & Skill 11 

18,386 

0.03 

0.86 

-3.71 

2.27 

Can Do Performance a 

23,836 

-0.05 

1.61 

-7.42 

4.53 

Will Do Performance a 

3,720 

0.25 

3.05 

-14.11 

8.61 

In-Unit 






Overall Performance 

2,368 

5.23 

1.18 

1.00 

7.00 

Commitment & Fit 

2,962 

3.55 

0.68 

1.22 

5.00 

Retention Cognitions 

2,962 

2.42 

0.66 

1.00 

4.14 

Knowledge & Skill a 

2,924 

-0.04 

0.95 

-4.22 

2.29 

Tier 2 

IMT 






Overall Performance 

280 

3.25 

0.75 

1.14 

5.00 

Commitment & Fit 

1,011 

4.06 

0.57 

1.33 

5.00 

Retention Cognitions 

1,011 

2.84 

0.57 

1.00 

4.00 

Knowledge & Skill a 

730 

0.08 

0.86 

-2.97 

2.17 

Can Do Performance a 

976 

0.04 

1.59 

-5.94 

4.35 

Will Do Performance a 

139 

-0.40 

3.07 

-7.67 

7.47 


Note. Tier 2 in-unit results are not reported because sample sizes are less than 100. Overall Performance scores for IMT Soldiers 
are on a 5-point scale. Overall Performance scores for in-unit Soldiers are on a 7-point scale. 

a The variables that are included in the criterion composites are reported on a standardized z-score scale (mean = 0). 
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Summary 


Criterion data, such as attrition, training restarts, and AIT course grades, were gathered from 
administrative records. In addition, three types of criterion measures were adapted from previous 
Army research to validate the TAPAS: (a) the JKTs, (b) the PRS, and (c) the ALQ. The JKTs 
measure WTBD (Army-wide) and MOS-specific knowledge for seven target MOS. These were 
combined with administrative records of AIT grades to form a Knowledge/Skill composite, 
intended to measure a Soldier’s task-specific knowledge. The PRS are completed by training 
cadre (IMT) or supervisors (in-unit) and measure Army-wide constructs such as effort and 
leadership and (for selected IMT MOS) MOS-specific competence. The PRS were combined to 
form an Overall Performance composite intended to measure cadre and/or supervisor ratings of a 
Soldier’s general performance level. The ALQ asks Soldiers to complete verifiable self-report 
performance items (e.g., their APFT scores) and self-report attitudinal items (e.g., adjustment to 
Army life). For the validation analyses, the ALQ scales were combined to form a Commitment 
& Fit composite and a Retention Cognitions composite. Finally, two criterion composites were 
created to measure general Can Do and Will Do performance. 

In general, the criterion measures described in this chapter exhibited acceptable and theoretically 
consistent psychometric properties. Nearly all reliability estimates for the JKTs and ALQ scales 
are acceptable and correlations among the scales are all in the theoretically consistent direction, 
(see Appendixes B and C). The correlations between IMT MOS-specific JKTs and AFQT scores 
ranged from moderate (r = .27) to strong (r = .46). In addition, MOS-specific JKTs correlated 
strongly with WTBD JKT scores. The exception to this was the Army-wide and MOS-specific 
PRS, which continued to exhibit low interrater reliability coefficients. Lower interrater reliability 
is not uncommon in military samples (Van Iddekinge et al., 2011) and despite the low reliability, 
both the current and past research has shown meaningful relationships between non-cognitive 
predictors and performance ratings (e.g., Knapp & Heffner, 2009; McHenry, Hough, Toquam, 
Hanson, & Ashworth, 1990). Because unreliability can attenuate correlations, this should be 
considered when interpreting results involving the PRS. 

Regarding the criterion scores used to validate the TAPAS predictor composites, the intent was 
to use criterion scores that would best measure performance aspects predicted by each of the 
three predictor composite scores. As further discussed in Chapter 3, the Can-Do predictor 
composite was constructed to predict technical training performance, which is captured by JKT 
scores and AIT grades. The Will-Do predictor composite was constructed to predict motivation- 
based performance, which is captured by AFQT, the PRS, and the ALQ criteria. The Adaptation 
predictor composite was constructed to predict attrition. Attrition is captured through 
administrative records of attrition and self-report measures of retention cognition. Chapter 5 
summarizes the validation results examining the relationships between the predictor composites 
and these criteria. 
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CHAPTER 5: EVIDENCE FOR THE PREDICTIVE VALIDITY OF THE TAPAS 


Michael G. Hughes, Bethany H. Bynum, (HumRRO), and Heather M. Mullins (ARI) 

This chapter evaluates the potential of the TAPAS to predict Soldiers’ performance and retention 
through their first enlistment term. We begin with a brief description of our analytic approach. 
Next, we summarize the main findings from incremental validity analyses of the (a) current 
TAPAS composites (Can-Do, Will-Do, Adaptation) and (b) criterion-specific TAPAS scales. 
Lastly, we discuss analyses that examined the implementation of TAPAS screens that were based 
on AFQT and TAPAS scores. Specifically, these analyses focused on (a) IMT and attrition 
outcomes based on Soldiers’ standing on AFQT categories and the TAPAS screen and (b) in-unit 
outcomes based on Soldiers’ percentile scores on the TAPAS. 

Analytic Approach 

To evaluate the TAPAS’ potential to enhance new Soldier selection, we examined the incremental 
validity of the TAPAS over the AFQT in predicting first-term outcomes important to the Army. 
Consistent with the Army’s personnel goals, we examined performance and retention-related 
outcomes that, as a group, provide representative coverage of the criterion space (Campbell, Hanson, 
& Oppler, 2001; Campbell, McHenry, & Wise, 1990; Knapp & Tremble, 2007; Strickland, 2005). 

Our analysis approach was generally consistent with previous evaluations of the TAPAS and 
similar experimental non-cognitive predictors (e.g., Ingerick et al., 2009; Knapp & Heffner, 

2009; 2010; Trippe, Caramagno, Allen, & Ingerick, 2011). In brief, this approach involved 
testing a series of two-step hierarchical regression models, where scores on each criterion 
measure or composite were regressed onto Soldiers’ AFQT scores in the first step, followed by 
scores on either the (a) TAPAS composites or (b) TAPAS scales in the second step. In each case, 
we evaluated the degree to which adding the predictor(s) in the second step provided incremental 
validity beyond the AFQT with respect to the criterion of interest. 

A series of four regression models were estimated for each criterion measure. Specifically, three 
of the four models each consisted of one TAPAS composite added in the second step of the 
model. The fourth model, however, varied depending on the specific criterion being examined. 
For Knowledge & Skill, Warrior Tasks and Battle Drills Job Knowledge Test (WTBD JKT), and 
Can Do Performance (i.e., Can Do criteria), the Can-Do TAPAS scales were included in the 
second step. For Army Fit, Army Life Adjustment, Commitment & Fit, Retention Cognitions, 
APFT Score, Will Do Performance, Disciplinary Incidents, IMT Restarts, and the Performance 
Rating Scales (PRS) of Effort and Discipline, Adjustment to the Army, Physical Fitness and 
Bearing, Working with Others, and Overall Performance (i.e., Will Do criteria), the Will-Do 
TAPAS scales were included in the second step. For the attrition criteria examined at 6, 12, and 
24 months, the Adaptation TAPAS scales were added in the second step. 

Estimates for the fourth model consisting of criterion-specific TAPAS scales represent the best-case 
scenario of the TAPAS predictive potential and were estimated using a combined Tier 1 and 2 
sample. Estimates for the TAPAS composite models capture the predictive potential of the 
composites as configured for operational usage. The TAPAS composite models were estimated using 
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a combined Tier 1 and 2 sample as well as separately by education tier where sample sizes were 
greater than 100. Attrition criteria were examined for Regular Army Soldiers only. Table 5.1 
provides a summary of each of the regression models. 


Table 5.1. Summary of Regression Models Evaluated for each Criterion 


Model 

Step 2 Predictors 

# of Predictors 
added in Step 2 

Description 

1 

TAPAS Can-Do Composite 

1 

The TAPAS Can-Do composite is a single variable 
based on scores from multiple TAPAS scales, and it 
was added to the model in Step 2. 

2 

TAPAS Will-Do Composite 

1 

The TAPAS Will-Do composite is a single variable 
based on scores from multiple TAPAS scales, and it 
was added to the model in Step 2. 

3 

TAPAS Adaptation 
Composite 

1 

The TAPAS Adaptation composite is a single variable 
based on scores from multiple TAPAS scales, and it 
was added to the model in Step 2. 

4 

TAPAS Facet Scales 




D V: Can Do Criteria 

6 

For models predicting Can Do criteria, the TAPAS 
scales that comprise the TAPAS Can-Do composite 
were added in Step 2. 


DV: Will Do Criteria 

4 

For models predicting Will Do criteria, the TAPAS 
scales that comprise the TAPAS Will-Do composite 
were added in Step 2. 


DV: Attrition 

4 

For models predicting Attrition, the TAPAS scales that 
comprise the TAPAS Adaptation composite were added 
in Step 2. 


Note. DV: Dependent Variable. All regression models included the AFQT as the only predictor in Step 1. The TAP AS Can-Do, 
Will-Do, and Adaptation composites each represent single variables comprising multiple TAP AS scales. Models 1 through 3 
were conducted for every criterion variable. For Model 4 (TAPAS Scales), the predictors added in Step 2 varied depending on the 
type of criteria. For security reasons, the specific TAP AS scales that form each composite are not provided here. 

In the present report, models predicting continuously scaled criteria were estimated using 
Ordinary Least Squares (OLS) regression. Logistic regression was used for the dichotomous 
criteria (i.e., attrition. Disciplinary Incidents, IMT Restarts). 13 Note that because different 
regression methods are required for different types of criteria (i.e., continuous vs. dichotomous), 
the statistical indices used to evaluate the OLS and logistic models also are different. Additional 
details concerning the specific indices presented for the logistic regression analyses are provided 
in the section on dichotomous outcomes later in the chapter. 

In addition to the incremental validity analyses, we examined the predictive validity of the 
individual TAPAS scales based on the bivariate correlations between scores on the TAPAS 
scales and the selected criterion measures. The results of these analyses are presented in 
Appendix D. 


13 The dichotomous version of Disciplinary Incidents (0 = no disciplinary incidents; 1 = one or more disciplinary 
incidents) was used for all analyses due to a low base rate beyond one incident. 
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Findings 


Results of these analyses are organized by criterion domain: (a) IMT performance, (b) in-unit 
performance, and (c) dichotomous outcomes. A few notes related to interpretation of the findings 
are in order: 

• The results for Tier 2 Soldiers should be interpreted with caution at this stage of the 
TOPS evaluation because of limited criterion data for those Soldiers. Accordingly, our 
discussion primarily focuses on the analyses of the combined Tier 1 and 2 sample of 
Soldiers. 14 

• Results of OLS regression analyses are discussed with respect to R values for all continuous 
criteria. Results of logistic regression analyses are discussed with respect to odds ratios (ORs) 
in combination with likelihood ratio % 2 tests of change in model fit (i.e., deviance) 

• Much of our discussion focuses on the TAPAS composite models because these models 
best evaluate the TAPAS’ current operational format as well as its potential future 
format. Similarly, tables of results included in this chapter include models of the TAPAS 
composites only. However, results of the criteria-specific TAPAS scales models are 
graphically displayed and briefly discussed. 

Predicting IMT Performance 

Tables 5.2 to 5.4 summarize the incremental validity results of the TAPAS composites for 
predicting IMT performance criteria over and above the AFQT. Overall, the results suggest that 
both the Will-Do and Adaptation TAPAS composites can enhance the Army’s ability to predict a 
number of important outcomes. Below, we describe the specific outcomes for which the TAPAS 
composites demonstrated notable predictive gains beyond the AFQT alone. 

With respect to the motivation-based performance criteria, the TAPAS composites exhibited gains 
in predictive validity over the AFQT in predicting several outcomes. In the combined Tier 1 and 2 
sample, the TAPAS Will-Do composite enhanced the prediction of the Will Do Performance 
composite (A R = .24), APFT Score (A R = .17), Commitment & Fit (A R = .12), and Army Life 
Adjustment (A R = .14); and to a lesser extent, the prediction of Army Fit (A R = .10) and the PRS 
criteria of Physical Fitness and Bearing (A R = .09), Adjustment to the Army (A R = .06), and 
Overall Performance (A R = .05). 

The TAPAS Adaptation composite also demonstrated incremental validity in the prediction of 
the Will Do Performance composite (A R = .12), APFT Score (A R = .10), Army Life Adjustment 
(A R = .05), and PRS: Physical Fitness and Bearing (A R = .05) in the combined sample. The Can- 
Do composite did not demonstrate any notable incremental validity in either the combined or 
Tier 1 samples for any of the motivation-based outcomes. However, it is not designed to predict 
Will Do criteria. 


14 Due to the large proportion of Tier 1 Soldiers relative to Tier 2 Soldiers, results for the combined Tier 1 and Tier 2 
sample were generally comparable to Tier 1 only results. 
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Table 5.2. Incremental Validity Estimates for the TAP AS over AFQT for Predicting IMT Technical Performance by Education Tier 



Tier 1+2 (Combined) 



Tier 1 



Tier 2 


IMT Criterion Measure / Model 

AFQT 

R 

AFQT + 

TAP AS R 

A R 

AFQT 

R 

AFQT + 

TAP AS R 

A R 

AFQT 

R 

AFQT + 

TAPAS R 

A R 

Knowledge & Skill 

n 

= 12,307- 17,737 


n 

= 11,858-17,075 



n = 449 - 662 


Can-Do a 

.45 

.46 

.00 

.46 

.46 

.00 

.36 

.36 

.00 

Will-Do 

.45 

.45 

.00 

.46 

.46 

.00 

.38 

.38 

.00 

Adaptation 

.45 

.45 

.00 

.46 

.46 

.00 

.38 

.38 

.00 

WTBD JKT 

n 

= 15,444 - 22,866 


n 

= 14,838-21,977 



n = 606 - 889 


Can-Do a 

.43 

.43 

.00 

.43 

.43 

.00 

.31 

.31 

.00 

Will-Do 

.43 

.43 

.00 

.43 

.43 

.00 

.34 

.34 

.00 

Adaptation 

.43 

.43 

.00 

.43 

.43 

.00 

.34 

.34 

.00 

Can Do Performance 

n 

= 15,555 - 23,048 


n 

= 14,943 - 22,152 



n = 612 - 896 


Can-Do a 

.44 

.45 

.00 

.45 

.45 

.00 

.33 

.33 

.00 

Will-Do 

.44 

.44 

.00 

.44 

.44 

.00 

.36 

.36 

.00 

Adaptation 

.44 

.44 

.00 

.44 

.44 

.00 

.36 

.36 

.00 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. R = multiple correlations between the AFQT and selected TAP AS composite scales with the targeted 
criterion measure. A R = Increment in R from adding the selected TAP AS composite scale to the regression model [(AFQT + TAP AS) - AFQT Only], Bolded values indicate p < .05. 
a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 



Table 5.3. Incremental Validity Estimates for the TAP AS over AFQT for Predicting IMT Adjustment, Commitment & Fit, Fitness, 
and Retention Criteria by Education Tier 


IMT Criterion Measure / Model 


Tier 1+2 (Combined) 


Tier 1 




Tier 2 


AFQT AFQT + 

R TAPAS R 

A R 

AFQT 

R 

AFQT + 
TAPAS R 

A R 

AFQT 

R 


AFQT + 
TAPAS R 

A R 

Army Fit 


n = 16,188 - 24,034 


n = 15,557 - 23,106 


n 

= 631 - 928 


Can-Do a 

.04 

.05 

.01 

.04 

.05 

.01 

.06 


.07 

.01 

Will-Do 

.04 

.14 

.10 

.04 

.13 

.10 

.05 


.17 

.11 

Adaptation 

.04 

.05 

.01 

.04 

.05 

.01 

.05 


.06 

.00 

Army Life Adjustment 


n = 16,188 - 24,034 


n = 15,557 - 23,106 


n 

= 631 - 928 


Can-Do a 

.06 

.09 

.03 

.06 

.09 

.03 

.02 


.04 

.02 

Will-Do 

.06 

.20 

.14 

.06 

.20 

.14 

.01 


.21 

.20 

Adaptation 

.06 

.11 

.05 

.06 

.11 

.05 

.01 


.06 

.05 

Commitment & Fit 


n = 16,188 - 24,034 


n = 15,557 - 23,106 


n 

= 631 - 928 


Can-Do a 

.00 

.02 

.02 

.01 

.02 

.02 

.02 


.02 

.00 

Will-Do 

.01 

.12 

.12 

.01 

.12 

.11 

.03 


.16 

.13 

Adaptation 

.01 

.04 

.03 

.01 

.04 

.03 

.03 


.04 

.02 

Retention Cognitions 


n = 16,188 - 24,034 


n = 15,557 - 23,106 


n 

= 631 - 928 


Can-Do a 

.13 

.14 

.01 

.13 

.14 

.01 

.14 


.14 

.00 

Will-Do 

.13 

.13 

.00 

.13 

.13 

.00 

.14 


.16 

.02 

Adaptation 

.13 

.13 

.00 

.13 

.13 

.00 

.14 


.14 

.00 

APFT Score 


n = 15,733-23,349 


n = 15,124 - 22,456 


n 

= 609 - 893 


Can-Do a 

.08 

.09 

.01 

.08 

.09 

.01 

.06 


.07 

.01 

Will-Do 

.09 

.27 

.17 

.09 

.26 

.17 

.08 


.28 

.21 

Adaptation 

.09 

.19 

.10 

.09 

.19 

.10 

.08 


.17 

.09 

Will Do Performance 


n = 2,620 - 3,511 



n = 2,537 - 3,387 




n = 124 


Can-Do a 

.02 

.03 

.01 

.02 

.03 

.00 

- 


- 

- 

Will-Do 

.05 

.29 

.24 

.05 

.29 

.24 

.03 


.24 

.22 

Adaptation 

.05 

.17 

.12 

.05 

.17 

.12 

.03 


.11 

.08 


Note. R = multiple correlations between the AFQT and selected TAP AS composite scales with the targeted criterion measure. A R = Increment in R from adding the selected TAP AS 
composite scale to the regression model [(AFQT + TAP AS) - AFQT Only]. Results based on fewer than 100 cases are not reported. Bolded values indicate p < .05. 
a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 



Table 5.4. Incremental Validity Estimates for the TAP AS over AFQT for Predicting IMT Performance Rating Criteria by Education Tier 



Tier 1+2 (Combined) 


Tier 1 




Tier 2 


IMT Criterion Measure / Model 

AFQT 

R 

AFQT + 
TAPAS R 

A R 

AFQT 

R 

AFQT + 
TAPAS R 

A R 

AFQT 

R 


AFQT + 
TAPAS R 

A R 

PRS: Effort and Discipline 


n = 4,940 - 7.069 


n = 4,764 - 6,797 


n 

= 176 - 272 


Can-Do a 

.08 

.08 

.00 

.08 

.08 

.00 

.01 


.08 

.07 

Will-Do 

.08 

.12 

.04 

.09 

.12 

.04 

.05 


.13 

.08 

Adaptation 

.08 

.10 

.01 

.09 

.10 

.01 

.05 


.08 

.02 

PRS: Adjustment to the Army 


n = 4,935 - 7,066 


n = 4,759-6,794 


n 

= 176 - 272 


Can-Do a 

.03 

.03 

.00 

.03 

.03 

.00 

.02 


.04 

.02 

Will-Do 

.05 

.10 

.06 

.05 

.10 

.06 

.04 


.06 

.03 

Adaptation 

.05 

.06 

.02 

.05 

.06 

.02 

.04 


.04 

.00 

PRS: Physical Fitness and Bearing 


n = 4,927 - 7,055 


n = 4,751 - 6,783 


n 

= 176 - 272 


Can-Do a 

.05 

.06 

.01 

.05 

.06 

.01 

.02 


.13 

.11 

Will-Do 

.06 

.15 

.09 

.06 

.15 

.09 

.04 


.15 

.11 

Adaptation 

.06 

.11 

.05 

.06 

.11 

.06 

.04 


.05 

.01 

PRS: Working with Others 


n = 4,917-7,031 



n = 4,743-6,763 


n 

= 174 - 268 


Can-Do a 

.06 

.06 

.00 

.06 

.06 

.00 

.01 


.08 

.08 

Will-Do 

.07 

.10 

.03 

.07 

.10 

.03 

.05 


.11 

.06 

Adaptation 

.07 

.08 

.01 

.07 

.08 

.01 

.05 


.09 

.03 

PRS: Overall Performance 


n = 4,634 - 6,529 


n = 4,468 - 6,274 


n 

= 166 - 255 


Can-Do a 

.08 

.08 

.00 

.08 

.08 

.00 

.07 


.10 

.03 

Will-Do 

.08 

.14 

.05 

.08 

.14 

.05 

.10 


.16 

.05 

Adaptation 

.08 

.10 

.02 

.08 

.10 

.02 

.10 


.11 

.01 


Note. PRS = Performance Rating Scales. R = multiple correlations between the AFQT and selected TAP AS composite scales with the targeted criterion measure. A R = Increment in R 


from adding the selected TAP AS composite scale to the regression model [(AFQT + TAP AS) - AFQT Only]. Bolded values indicate p < .05. 
a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 



Consistent with expectations and previous analyses, the TAPAS composites (Can-Do, Will-Do, 
and Adaptation) evidenced no notable increments over the AFQT in predicting scores on the 
composite measure of Knowledge & Skill (A R < .01). Similarly, the TAPAS composites did not 
show incremental validity in the prediction of the other Can Do criteria, namely WTBD JKT and 
the Can Do Performance composite (ARs < .01). These results are not surprising given that the 
AFQT is an established strong predictor of Can Do outcomes. 

Figures 5.1 and 5.2 provide results of the combined Tier 1 and 2 analyses examining the 
incremental validity of criteria-specific TAPAS scales over and above the AFQT for Will Do and 
Can Do criteria, respectively. Similar to the results of the TAPAS composite models, the Will- 
Do scales provided the largest gains over the AFQT. In particular, increases in R were largest for 
the Will Do Performance composite, APFT Score, Army Life Adjustment, Commitment & Fit, 
Army Fit, and PRS: Physical Fitness and Bearing {ARs > .10). Results of the Can-Do TAPAS 
scales showed no notable increments over the AFQT in predicting the Can Do criteria. 


IMT Will Do Criteria and TAPAS Scales 


Army Fit 
Army Life Adjustment 
Commitment & Fit 
Retention Cognitions 
APFT Score 
Will Do Performance 
PRS: Effort and Discipline 
PRS: Adjustment to the Army 
PRS: Physical Fitness & Bearing 
PRS: Working with Others 
PRS: Overall Performance 



■ AFQT 
HTAPAS 


.00 


.05 


.10 


.15 


.20 


.25 


.30 


R 


Figure 5.1. Increase in prediction of IMT criteria using Will-Do TAPAS scales for the 
combined Tier 1 and 2 sample. 


IMT Can Do Criteria and TAPAS Scales 

Knowledge & Skill 
WTBD JKT 
Can Do Performance 

.00 .10 .20 .30 .40 .50 

R 

Figure 5.2. Increase in prediction of IMT criteria using Can-Do TAPAS scales for the 
combined Tier 1 and 2 sample. 


■ AFQT 
B TAPAS 


38 





Predicting In-Unit Performance 


The incremental validity results for predicting in-unit performance are presented in Tables 5.5 to 
5.7. Similar to the results for the IMT performance criteria, these results also suggest that the 
TAPAS composites are useful predictors of in-unit performance outcomes. For multiple 
outcomes, the Will-Do and Adaptation TAPAS composites both exhibited enhanced prediction 
beyond the AFQT alone. Results for which notable predictive gains were observed are detailed 
below. Note that separate analyses were not conducted for Tier 2 Soldiers due to limited in-unit 
criterion data available for those Soldiers (ns < 100). 

For motivation-based criteria, however, the Will-Do composite showed increases beyond the 
AFQT in predicting the APFT Score (A R = .23) and PRS: Physical Fitness and Bearing (A R = 
.11). Smaller increases in the prediction of PRS: Overall Performance and PRS: Leadership 
Potential (ARs = .05) were also shown. With respect to the combined Tier 1 and 2 sample results, 
none of the TAPAS composite predictors demonstrated incremental validity beyond the AFQT in 
the prediction of Knowledge & Skill or WTBD JKT scores (ARs < .01). 

The TAPAS Adaptation composite also demonstrated incremental validity for predicting the 
APFT Score (A R = .14) and PRS: Physical Fitness and Bearing (A R = .07) in the combined 
sample. Similar to the analyses of the IMT criteria, the Can-Do composite did not provide 
incremental validity in the prediction of any in-unit criteria. However, this result is expected 
given that the Can-Do composite is not intended to be related to Will Do outcomes, and the 
AFQT is an established strong predictor of Can Do outcomes. 


Table 5.5. Incremental Validity Estimates for the TAPAS over AFQT for Predicting In-Unit 
Technical Performance Criteria by Education Tier 



Tier 1+2 (Combined) 



Tier 1 


In-Unit Criterion Measure / Model 

AFQT R 

AFQT + 
TAPAS R 

A R 

AFQT R 

AFQT + 
TAPAS R 

A R 

Knowledge & Skill 

n 

= 2,014-2,795 


n 

= 1,954-2,712 


Can-Do a 

.45 

.46 

.01 

.46 

.46 

.01 

Will-Do 

.46 

.46 

.00 

.46 

.46 

.00 

Adaptation 

.46 

.46 

.00 

.46 

.46 

.00 

WTBD JKT 

n 

= 2,008 - 2,788 


n 

= 1,948-2,705 


Can-Do a 

.44 

.45 

.01 

.44 

.45 

.01 

Will-Do 

.45 

.45 

.00 

.45 

.45 

.00 

Adaptation 

.45 

.45 

.00 

.45 

.45 

.00 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. R = multiple correlations between the AFQT and 
selected TAPAS composite scales with the targeted criterion measure. A R = Increment in R from adding the selected TAPAS 
composite scale to the regression model [(AFQT + TAPAS) - AFQT Only]. Tier 2 results are not reported because sample sizes 
are less than 100. Bolded values indicate p < .05. 

a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 
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Table 5.6. Incremental Validity Estimates for the TAPAS over AFQT for Predicting In-Unit 
Adjustment, Commitment & Fit, Fitness, and Retention Criteria by Education Tier 


In-Unit Criterion Measure / Model 


Tier 1+2 (Combined) 


Tier 1 


AFQT + 
AFQT R TAPAS R 

A R 

AFQT R 

AFQT + 
TAPAS R 

A R 

Army Fit 


n = 2,038 - 2,831 



n = 1,976-2,745 

Can-Do a 

.04 

.05 

.01 

.04 

.05 

.01 

Will-Do 

.03 

.07 

.04 

.03 

.07 

.04 

Adaptation 

.03 

.04 

.01 

.03 

.04 

.00 

MOS Fit 


n = 2,038 - 2,831 



n = 1,976-2,745 

Can-Do a 

.00 

.01 

.01 

.01 

.01 

.00 

Will-Do 

.01 

.03 

.03 

.01 

.04 

.03 

Adaptation 

.01 

.03 

.02 

.01 

.03 

.02 

Commitment & Fit 


n = 2,038 - 2,831 



n = 1,976-2,745 

Can-Do a 

.04 

.05 

.00 

.04 

.05 

.00 

Will-Do 

.03 

.07 

.03 

.03 

.07 

.03 

Adaptation 

.03 

.04 

.01 

.03 

.04 

.00 

Retention Cognitions 


n = 2,038 - 2,831 



n = 1,976-2,745 

Can-Do a 

.12 

.12 

.00 

.12 

.12 

.00 

Will-Do 

.12 

.12 

.00 

.12 

.12 

.00 

Adaptation 

.12 

.12 

.00 

.12 

.12 

.00 

APFT Score 


n = 1,941 -2,713 


n = 1,881 - 2,632 

Can-Do a 

.03 

.04 

.01 

.03 

.04 

.02 

Will-Do 

.01 

.24 

.23 

.01 

.24 

.22 

Adaptation 

.01 

.16 

.14 

.01 

.15 

.14 


Note. R = multiple correlations between the AFQT and selected TAPAS composite scales with the targeted criterion measure. A R 
= Increment in R from adding the selected TAPAS composite scale to the regression model [(AFQT + TAPAS) - AFQT Only], 
Tier 2 results are not reported because sample sizes are less than 100. Bolded values indicate p < .05. 

“ Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 
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Table 5. 7. Incremental Validity Estimates for the TAP AS over AFQT for Predicting In-Unit 
Performance Rating Criteria by Education Tier 


In-Unit Criterion Measure / Model 


Tier 1+2 (Combined) 


Tier 1 


AFQT + 
AFQT R TAPAS R 

A R 

AFQT R 

AFQT + 
TAPAS R 

A R 

PRS: Effort and Discipline 


n = 1,614 - 2,264 


n = 1,565-2,193 

Can-Do a 

.10 

.10 

.00 

.10 

.10 

.00 

Will-Do 

.10 

.12 

.02 

.10 

.12 

.02 

Adaptation 

.10 

.11 

.00 

.10 

.11 

.00 

PRS: Working with Others 


n = 1,615 - 2,265 


n = 1,566-2,194 

Can-Do a 

.12 

.12 

.00 

.12 

.12 

.00 

Will-Do 

.12 

.15 

.03 

.12 

.15 

.03 

Adaptation 

.12 

.12 

.01 

.12 

.12 

.00 

PRS: Physical Fitness and Bearing 


n = 1,607 - 2,255 


n = 1,558 - 2,185 

Can-Do a 

.03 

.03 

.00 

.03 

.04 

.00 

Will-Do 

.03 

.13 

.11 

.03 

.13 

.11 

Adaptation 

.03 

.09 

.07 

.03 

.09 

.06 

PRS: Leadership Potential 


n = 1,576 - 2,208 


n = 1,527-2,137 

Can-Do a 

.08 

.08 

.00 

.08 

.08 

.00 

Will-Do 

.08 

.13 

.05 

.07 

.13 

.05 

Adaptation 

.08 

.09 

.02 

.07 

.09 

.02 

PRS: Overall Performance 


n = 1,613 - 2,261 



n = 1,564-2,190 

Can-Do a 

.09 

.09 

.00 

.09 

.09 

.00 

Will-Do 

.09 

.14 

.05 

.09 

.14 

.05 

Adaptation 

.09 

.10 

.02 

.09 

.10 

.01 


Note. PRS = Performance Rating Scales. R = multiple correlations between the AFQT and selected TAP AS composite scales 
with the targeted criterion measure. A R = Increment in R from adding the selected TAP AS composite scale to the regression 
model [(AFQT + TAP AS) - AFQT Only]. Tier 2 results are not reported because sample sizes are less than 100. Bolded values 
indicate p < .05. 

a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 


The results of the combined Tier 1 and 2 incremental validity analyses for criterion-specific 
TAPAS scales are shown in Figures 5.3 and 5.4 for Will Do and Can Do criteria, respectively. 
Similar to the results of the TAPAS composite models predicting both IMT and in-unit criteria, 
the Will-Do scales provided the largest gains over the AFQT. Increases in R were largest for the 
APFT Score and PRS: Physical Fitness and Bearing (ARs > .10). Results of the model including 
the Can-Do TAPAS scales exhibited negligible increments beyond AFQT in predicting either 
Knowledge & Skill or the WTBDJKT." 
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In-Unit Will Do Criteria and TAPAS Scales 


Army Fit 
MOS Fit 
Commitment & Fit 
Retention Cognitions 
APFT Score 
PRS: Effort and Discipline 
PRS: Physical Fitness & Bearing 
PRS: Working with Others 
PRS: Leadership Potential 
PRS: Overall Performance 

.00 .05 .10 .15 .20 .25 .30 

R 

Figure 5.3. Increase in prediction of in-unit criteria using Will-Do TAPAS scales for the 
combined Tier 1 and 2 sample. 

In-Unit Can Do Criteria and TAPAS Scales 

Knowledge & Skill 
WTBD JKT 

.00 .10 .20 .30 .40 .50 

R 

Figure 5.4. Increase in prediction of in-unit criteria using Can-Do TAPAS scales for the 
combined Tier 1 and 2 sample. 

Predicting Dichotomous Outcomes 

In addition to the OLS regression analyses of IMT and in-unit criteria, we conducted logistic 
regression analyses of the dichotomous outcomes, including Disciplinary Incidents (measured at 
both IMT and In-Unit), IMT Restarts, and attrition at 6, 12, and 24 months. For these models, we 
estimated odds ratios (ORs) for the predictors as well as the corresponding confidence intervals 
(CIs). Additionally, we computed point biserial correlations (: r p b ) and conducted % 2 tests of the 
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change in model deviance (i.e., negative two log likelihood; -2LL) from the AFQT-only to the 
AFQT + TAPAS composite models. 

Odds ratios can be used to assess the likelihood (or odds) of a given outcome depending on 
change in a predictor. Specifically, for a given logistic regression model, a unique odds ratio is 
estimated for each predictor, and represents the amount of change in the odds of the outcome that 
is associated with change in the given predictor. For the present analyses, the ORs represent the 
amount of change in the likelihood of each outcome that can be attributed to every 1.0 change in 
the predictor score. Note that ORs equal to 1.0 reflect no relationship between a given predictor 
and outcome, ORs greater than 1.0 reflect positive relationships, and ORs between 0.0 and than 
1.0 reflect negative relationships (i.e., decreasing odds of the outcome with increasing values of 
the predictor). For ORs below 1.0, values closer to 0.0 indicate stronger negative relationships. 
Although values of ORs cannot fall below 0.0, there is no upper limit for ORs (Cohen, Cohen, 
West, & Aiken, 2003). In addition, we computed 95% CIs for the ORs, which can be interpreted 
as an index of statistical significance for each. That is, a Cl that contains 1.0 suggests that the 
relationship between the associated predictor and outcome is not significant. 

Point biserial correlations represent the correlation between a Soldier’s predicted probability of 
exhibiting a selected behavior and his or her actual behavior (e.g., being involved in a 
disciplinary incident; Tabachnick & Fidell, 2013). As such, stronger point biserial correlations 
reflect stronger relationships between predicted and observed outcomes, and thus are indicative 
of better-fitting models. Model deviance (i.e., -2LL) also provides an index of model fit. 
Moreover, the difference in deviances obtained from nested logistic regression models can be 
tested using likelihood ratio % 2 tests to determine the statistical significance of change in model 
fit between models. In the present application, statistically significant likelihood ratio % 2 tests of 
the change in deviances suggest that the inclusion of a given TAPAS composite to a regression 
model provides significantly better prediction of the outcome than the AFQT alone. 

Results of the analyses examining Disciplinary Incidents (IMT and in-unit) and IMT Restarts are 
provided in Table 5.8. For the combined Tier 1 and 2 sample, both the Will-Do and Adaptation 
TAPAS composites enhanced the prediction of IMT Disciplinary Incidents and IMT Restarts 
beyond the AFQT-only models. Specifically, for both Disciplinary Incidents (ORwiii-Do = .986; 
ORAdaptation = .990) and IMT Restarts (ORwiii-Do = .994; ORAdaptation = .995), ORs associated with 
both composites were below 1.0, indicating that as scores on these composites went up, the 
likelihood of the outcome went down. For in-unit Disciplinary Incidents, only the Will-Do 
composite had a significant relationship (ORwiii-Do = .991) and resulted in better model fit over 
the AFQT alone. The Can-Do composite did not predict either IMT or in-unit Disciplinary 
Incidents (as evidenced by CIs that include 1.000 for the associated ORs). Furthermore, the 
addition of the Can-Do composite to the AFQT-only model did not lead to an improvement in fit 
for models predicting Disciplinary Incidents (IMT and in-unit) or IMT Restarts. 

Table 5.9 presents the results of the logistic regression analyses examining attrition through 6, 

12, and 24 months of service for Regular Army. The Will-Do (.989 ^ ORwiii-Do ^ .992) and 
Adaptation (.990 ^ ORAdaptation ^ .992) composites were negatively related to attrition at all three 
time points, and their respective inclusion in the models resulted in significantly better fit over 
the AFQT alone. The TAPAS Can-Do composite was not related to attrition at any of the time 
points for Regular Army Soldiers (all OR CIs include 1.000). 
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Table 5.8. Incremental Validity Estimates for the TAP AS Composites over AFQT for Predicting Dichotomous Criteria by Education 
Tier 



Tier 1+2 (Combined) 



Tier 1 




Tier 2 



Criterion Measure / Model 

ORafqt 

ORtapas 



ORafqt 

ORtapas 



ORafqt 

ORtapas 




(Cl) 

(Cl) 

r„b 

A-2LL 

(Cl) 

(Cl) 

Ypb 

A-2LL 

(Cl) 

(Cl) 

r„b 

A-2LL 

IMT Disciplinary Incidents 

n = 

= 14,582 - 22,420 


n = 

= 13,997-21,539 



n = 585 - 881 



Can-Do a 













AFQT 

.996 


.03 


.996 


.03 


1.000 


_ b 



(.994-.998) 



(.994-.998) 



(.989-1.011) 




AFQT+TAPAS 

.997 

.999 

.03 

1.35 

.997 

.999 

.04 

1.79 

.999 

1.003 

0.02 

0.24 


(.994-.999) 

(.997-1.001) 

(.994-.999) 

(.996-1.001) 

(.987-1.011) 

(.992-1.013) 

Will-Do 













AFQT 

.997 


.03 


.996 


.03 


1.003 


0.02 



(.995-.998) 



(.995-.998) 



(.994-1.012) 



AFQT + TAPAS 

.998 

.986 

.11 

282.42 

.998 

.986 

.12 

274.56 

1.003 

.989 

0.09 

6.71 


(.996-.999) 

(.984-.988) 

(.996-.999) 

(.984-.988) 

(.994-1.012) 

(.981-.997) 

Adaptation 













AFQT 

.997 


.03 


.996 


.03 


1.003 


0.02 



(.995-.998) 



(.995-.998) 



(.994-1.012) 



AFQT + TAPAS 

.998 

.990 

.08 

130.74 

.998 

.990 

.08 

131.08 

1.003 

.996 

0.04 

0.85 


(.996-1.000) 

(.989-.992) 

(.996-1.000) 

(.989-.992) 

(.994-1.012) 

(.988-1.004) 

IMT Restarts 

n = 

168,250 - 290,220 


n = 

161,231 - 278,633 


n ■ 

= 7,019 -11,587 


Can-Do a 













AFQT 

1.002 


.01 


1.001 


.01 


1.010 


.04 



(1.000-1.003) 



(1.000-1.002) 



(1.004-1.017) 



AFQT+TAPAS 

1.001 

1.001 

.01 

0.83 

1.001 

1.000 

.01 

0.58 

1.010 

1.001 

.04 

0.20 


(1.000-1.003) 

(.999-1.002) 

(1.000-1.002) 

(.999-1.002) 

(1.003-1.017) 

(.996-1.007) 

Will-Do 













AFQT 

1.001 


.00 


1.000 


.00 


1.007 


.03 



(1.000-1.001) 



(1.000-1.001) 



(1.002-1.012) 



AFQT + TAPAS 

1.001 

.994 

.03 

205.42 

1.001 

.993 

.03 

211.89 

1.007 

1.000 

.03 

0.03 


(1.000-1.002) 

(.993-.994) 

(1.000-1.002) 

(.992-.994) 

(1.002-1.012) 

(.995-1.004) 

Adaptation 













AFQT 

1.001 


.00 


1.000 


.00 


1.007 


.03 



(1.000-1.001) 



(1.000-1.001) 



(1.002-1.012) 



AFQT + TAPAS 

1.001 

.995 

.02 

144.51 

1.001 

.995 

.02 

145.29 

1.007 

.998 

.03 

0.88 


(1.001-1.002) 

(.994-.996) 

(1.000-1.002) 

(.994-.995) 

(1.002-1.012) 

(.994-1.002) 



Table 5.8. (Continued) 



Tier 1+2 (Combined) 



Tier 1 




Tier 2 

Criterion Measure / Model 

ORafqt 

ORtapas 



ORafqt 

ORtapas 



ORafqt 

ORtapas 


(Cl) 

(Cl) 

r,,b 

A-2LL 

(Cl) 

(Cl) 

Vpb 

A-2LL 

(Cl) 

(Cl) r„ h A-2LL 

In-Unit Disciplinary 
Incidents 

n 

= 2,038 - 2,831 


n 

= 1,976-2,745 



n = 62- 86 

Can-Do a 











AFQT 

.995 

(.991-1.000) 


.04 


.995 

(.990-1.000) 


.04 


- 

- 

AFQT+TAPAS 

.997 

(.992-1.003) 

.996 

(.991-1.001) 

.05 

2.42 

.997 

(.992-1.003) 

.996 

(.991-1.001) 

.05 

2.15 

- 

- - 

Will-Do 











AFQT 

.994 

(.990-.999) 


.05 


.994 

(.990-.999) 


.05 


- 

- 

AFQT + TAPAS 

.994 

(.990-.999) 

.991 

(.987-.995) 

.09 

15.96 

.994 

(.990-.999) 

.991 

(.987-.996) 

.09 

13.92 

- 

- 

Adaptation 











AFQT 

.994 

(.990-.999) 


.05 


.994 

(.990-.999) 


.05 


- 

- 

AFQT + TAPAS 

.995 

(.991-.999) 

.996 

(.992-1.001) 

.06 

2.73 

.995 

(.990-.999) 

.997 

(.992-1.001) 

.06 

2.02 

- 

- - 


Note. OR = odds ratio for each predictor. Cl = 95% confidence interval of the odds ratio. r p b = point biserial correlation between the observed outcome and predicted probability. 
A-2LL = change in negative two log likelihood (deviance) from adding the selected TAP AS composite score to the AFQT-only logistic regression model. Odds ratios equal to 1.0 
(or confidence intervals of the odds ratio that include 1.0) indicate no relationship between the predictor and criterion. Odds ratios less than 1.0 indicate a negative relationship 
between the predictor and criterion. Odds ratios greater than 1.0 indicate a positive relationship between the predictor and criterion. For A-2LL. bolded values indicate significant 
change in model fit based on a Likelihood Ratio % 2 test, p < .05. Tier 2 results are not reported for in-unit Disciplinary Incidents because sample sizes are less than 100. 
a Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 

b The point biserial correlation could not be computed because there was no variance in predicted values for Tier 2 IMT Disciplinary Incidents for this sample. 



Table 5.9. Incremental Validity Estimates for the TAPAS Composite Scores over AFQT for Predicting Cumulative Attrition 
through 24 Months of Service by Education Tier (Regular Army Only) 



Tier 1+2 (Combined) 



Tier 1 




Tier 2 



Attrition Measure / Model 

ORafqt 

ORtapas 



ORafqt 

ORtapas 



ORafqt 

ORtapas 




(Cl) 

(Cl) 

r„b 

A-2LL 

(Cl) 

(Cl) 

fpb 

A-2LL 

(Cl) 

(Cl) 

r„b 

A-2LL 

6 Month 

n = 

92,364 -156,712 


n = 

88,701 - 151,312 


n 

= 3,663 - 5,400 


Can-Do a 













AFQT 

.990 


.06 


.989 


.06 


.996 


.02 



(.989-.991) 



(.988-.991) 



(.990-1.002) 



AFQT+TAPAS 

.989 

1.001 

.06 

5.97 

.989 

1.001 

.06 

3.70 

.995 

1.002 

.03 

0.53 


(.988-.990) 

(1.000-1.003) 

(.988-.990) 

(1.000-1.002) 

(.989-1.001) 

(.997-1.007) 

Will-Do 













AFQT 

.990 


.06 


.990 


.06 


.994 


.04 



(.989-.991) 



(.989-.991) 



(.989-.998) 



AFQT + TAPAS 

.991 

.990 

.08 

573.37 

.990 

.990 

.09 

568.47 

.994 

.994 

.05 

8.07 


(.990-.991) 

(.989-.991) 

(.989-.991) 

(.989-.990) 

(.989-.998) 

(.990-.998) 

Adaptation 













AFQT 

.990 


.06 


.990 


.06 


.994 


.04 



(.989-.991) 



(.989-.991) 



(.989-.998) 



AFQT + TAPAS 

.991 

.991 

.08 

482.47 

.991 

.990 

.08 

488.37 

.994 

.997 

.04 

2.29 


(.991-.992) 

(.990-.991) 

(.990-.992) 

(.989-.991) 

(.989-.999) 

(.993-1.001) 

12 Month 

n = 

76,174 -136,682 


n = 

73,818 - 132,869 


n 

= 2,356 - 3,813 


Can-Do a 













AFQT 

.991 


.06 


.991 


.06 


.999 


.01 



(.990-.992) 



(.990-.992) 



(.992-1.005) 



AFQT+TAPAS 

.991 

1.001 

.06 

2.03 

.991 

1.000 

.06 

0.68 

.997 

1.004 

.03 

2.23 


(.990-.992) 

(1.000-1.002) 

(.990-.992) 

(.999-1.002) 

(.990-1.004) 

(.999-1.010) 

Will-Do 













AFQT 

.992 


.05 


.992 


.06 


.996 


.02 



(.991-.993) 



(.991-.992) 



(.991-1.001) 



AFQT + TAPAS 

.992 

.989 

.09 

648.80 

.992 

.989 

.09 

650.04 

.996 

.996 

.04 

3.54 


(.992-.993) 

(.989-.990) 

(.991-.993) 

(.988-.990) 

(.991-1.001) 

(.991-1.000) 

Adaptation 













AFQT 

.992 


.05 


.992 


.06 


.996 


.02 



(.991-.993) 



(.991-.992) 



(.991-1.001) 



AFQT + TAPAS 

.993 

.990 

.08 

557.58 

.993 

.990 

.09 

567.05 

.996 

.998 

.03 

0.81 


(.992-.994) 

(.989-.991) 

(.992-.994) 

(.989-.991) 

(.991-1.001) 

(.994-1.002) 



Table 5.9. (Continued) 



Tier 1+2 (Combined) 



Tier 1 




Tier 2 


Attrition Measure / Model 

ORafqt 

ORtapas 


ORafqt 

ORtapas 



ORafqt 

ORtapas 



(Cl) 

(Cl) r„ b 

A-2LL 

(Cl) 

(Cl) 

r P b 

A-2LL 

(Cl) 

(Cl) 

Tpb A-2IJ,/ 

24 Month 

n 

= 64,417 - 87,733 


n = 

62,243 - 84,503 


n 

= 2,174 - 3,230 

Can-Do a 











AFQT 

.991 

.07 


.990 


.07 


.993 


.05 


(.990-.991) 


(.989-.991) 



(.987-.999) 


AFQT+TAPAS 

.990 

1.001 

1.55 

.990 

1.001 

.07 

0.82 

.993 

1.000 

.05 0.01 


(.989-.991) 

(1.000-1.002) 

(.989-.991) 

(.999-1.002) 

(.986-.999) 

(.995-1.005) 

Will-Do 











AFQT 

.990 

.07 


.990 


.08 


.991 


.06 


(.990-.991) 


(.989-.991) 



(.986-.996) 


AFQT + TAPAS 

.991 

992 

09 

301.61 

.991 

.992 

.10 

294.85 

.991 

.996 

.07 4.12 


(.990-.992) 

(.991-.993) 

(.990-.991) 

(.991-.993) 

(.986-.996) 

(.991-1.000) 

Adaptation 











AFQT 

.990 

.07 


.990 


.08 


.991 


.06 


(.990-.991) 


(.989-.991) 



(.986-.996) 


AFQT + TAPAS 

.992 

992 

09 

311.33 

.991 

.992 

.10 

312.76 

.991 

.997 

.06 1.63 


(.991-.992) 

(.991-.993) 

(.990-.992) 

(.991-.993) 

(.986-.996) 

(.993-1.001) 


Note. OR = odds ratio for each predictor. Cl = 95% confidence interval of the odds ratio. r p t = point biserial correlation between the observed outcome and predicted probability. 
A-2LL = change in negative two log likelihood (deviance) from adding the selected TAP AS composite score to the AFQT-only logistic regression model. Odds ratios equal to 1.0 
(or confidence intervals of the odds ratio that include 1.0) indicate no relationship between the predictor and criterion. Odds ratios less than 1.0 indicate a negative relationship 


between the predictor and criterion. Odds ratios greater than 1.0 indicate a positive relationship between the predictor and criterion. For A-2LL. bolded values indicate significant 
change in model fit based on a Likelihood Ratio % 2 test, p < .05. 

“ Because the Can-Do composite is based on a subset of the data, these results may underestimate its incremental validity. 



Figures 5.5 and 5.6 display the accuracy of the logistic regression models in predicting the 
dichotomous outcomes (Disciplinary Incidents, IMT Restarts, and attrition) for the combined 
Tier 1 and 2 sample. For each outcome, results are presented for three models which include the 
following predictors: (1) AFQT, (2) TAPAS composite, and (3) AFQT + TAPAS composite. 
Specifically, the percent accurate values are equal to the c statistic, or area under the receiver 
operating characteristic (ROC) curve, which reflects the ability of the given model to correctly 
discriminate between a case and a noncase (e.g., attriter vs. stayer). 15 The area under the curve 
(AUC) can range from .50 to 1.0, corresponding to 50% (or chance) and 100% accuracy, 
respectively. Note that the AUC is the probability that predicted scores are higher for true cases 
than noncases, and not the probability that a case is correctly classified (Cook, 2007). 
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0.57 

0.56 
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< 0.54 

I 0.53 
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Predictive Accuracy of the AFQT and Will-Do Composite: 
Disciplinary Incidents and IMT Restarts 



AFQT 
ss TAPAS 
■ AFQT+TAPAS 


IMT Disciplinary 
Incidents 


In-Unit Disciplinary 
Incidents 


IMT Restarts 


Figure 5.5. Predictive accuracy of the AFQT and Will-Do TAPAS composite in the discrimination 
of both IMT and In-Unit Disciplinary Incidents and IMT Restarts for the combined Tier 1 and 2 
sample. 


In particular, Figure 5.5 displays the results of the AFQT and Will-Do TAPAS composite models 
in predicting Disciplinary Incidents (IMT and in-unit) and IMT Restarts. For all three criteria, the 
probability of discriminating between Soldiers with and without incidence of the outcome of 
interest is lowest (less than 53%) when using the AFQT alone. However, the predictive accuracy 
increases for the Will-Do composite and AFQT + Will-Do composite models for all outcomes. 


15 The ROC curve is a plot of sensitivity (i.e., probability of detecting a true positive) versus specificity (i.e., 
probability of detecting a true negative) across a range of potential cut scores for continuous predictors in a logistic 
regression model (Cook, 2007). For the purposes of evaluating the logistic regression models discussed in this 
report, only the area under the ROC curve (i.e., AUC) is presented and discussed. 
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In particular, the combined model demonstrated the most accuracy, ranging from 57.9% for IMT 
Disciplinary Incidents to 53.6% for IMT Restarts. In addition, the increase in predictive accuracy 
for the combined model compared to the Will-Do composite-only model was generally small, 
suggesting that the AFQT adds little value to the discrimination of these dichotomous outcomes. 

Figure 5.6 displays the results of the AFQT and Adaptation TAPAS composite models in 
predicting attrition for Regular Army Soldiers. For 6-, 12-, and 24-month attrition, the combined 
AFQT + Adaptation composite model resulted in the most accurate predictions (approximately 
57% for each time point). However, when comparing the AFQT-only and Adaptation composite- 
only models, the more accurate of the two individual predictors varied by time point. 

Specifically, the Adaptation composite-only model evidenced more accurate prediction of 
attrition at 6 and 12 months, and the AFQT-only model evidenced slightly better prediction of 
attrition at 24 months. Moreover, for each time point, the predictive accuracy of the combined 
model improved by at least 1% over either predictor alone, suggesting that both the AFQT and 
Adaptation TAPAS composite contribute to the prediction of attrition. 
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Predictive Accuracy of the AFQT and Adaptation Composite: 

Attrition 
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Figure 5.6. Predictive accuracy of the AFQT and Adaptation TAPAS composite in the 
discrimination of attrition outcomes for Regular Army Soldiers in the combined Tier 1 and 2 
sample. 
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Implementation 


To further examine the relationships between the TAPAS and the various IMT, in-unit, and 
attrition criteria, we conducted analyses that assessed implementation of the TAPAS with respect 
to AFQT Test Score Categories (TSC) and TAPAS score percentiles. Soldiers are classified into 
AFQT TSC based on their performance on the AFQT (described in Chapter 2). For Tier 1 
Soldiers, those with AFQT scores falling in TSC IIIB or IV pass initial screening if both their 
TAPAS Will-Do and TAPAS Adaptation composite scores are at or above the 10 th percentile 
(i.e., II IB Pass, IV Pass) 16 . Soldiers in AFQT TSC II IB and IV who score below the 10 th 
percentile on the TAPAS composites are screened out (i.e., TU B Fail, IV Fail). For Tier 2 
Soldiers in AFQT TSC I through IV, only those with TAPAS Will-Do composite scores in the 
top 70% pass initial screening (i.e., Tier 2 Pass), while scorers in the bottom 30% are classified 
as failing (Tier 2 Fail). Soldiers in AFQT TSC V are screened out regardless of TAPAS scores. 

The following analyses examine scores on key outcomes for (a) Tier 1 Soldiers from each AFQT 
TSC (including TUB and IV TAPAS Pass and Fail) as well as (b) Tier 2 TAPAS Pass and Fail 
Soldiers relative to Tier 1 Soldiers. In general, the results highlight the performance differences 
between Soldiers who pass the TAPAS screen compared to those who fail. 

In particular, we computed Soldiers’ IMT mean scores for APFT Score, Army Life Adjustment, 
Army Fit, PRS: Physical Fitness and Bearing, PRS: Adjustment to the Army, and PRS: Working 
with Others by AFQT TSC. In addition, we computed Soldiers’ IMT and attrition percent 
frequencies for IMT Restarts, Disciplinary Incidents, and attrition at 6, 12, and 24 months by 
AFQT TSC. The relationships between IMT criteria by AFQT TSC for Tier 1 Soldiers are 
presented in Figure 5.7. 

As expected, Figure 5.7 demonstrates that Soldiers scoring higher on the AFQT generally 
receive more favorable scores on the IMT criteria with the exceptions of Army Fit and IMT 
Restarts. Importantly, these graphs also highlight a clear distinction among TAPAS passers and 
failures in AFQT TSC IIIB and IV. For every criterion, Soldiers in the IIIB and IV TAPAS Pass 
categories had better outcomes than Soldiers in the corresponding AFQT Fail category. For 
example, average APFT Score for IIIB and IV TAPAS Pass Soldiers were 9 and 8 points higher 
than their respective TUB and IV TAPAS Fail counterparts. Army Life Adjustment and 
Disciplinary Incidents were also markedly better for Soldiers categorized as IIIB and IV TAPAS 
Pass compared to TUB and IV Fail, respectively. Moreover, Soldiers in TSC TUB TAPAS Pass 
and IV TAPAS Pass had better outcomes than IIIA Soldiers on some criterion measures, 
including Army Life Adjustment, Army Fit, PRS: Physical Fitness and Bearing, IMT Restarts, 
and Disciplinary Incidents. 


16 In April 2015, the operational implementation of TAPAS was scaled back to allow all Tier 1 Category IIIB 
applicants to enlist regardless of their TAPAS scores. 
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PRS: Physcial Fitness & Bearing 

3.8 t- 



I 

n= 6.585 


n mA he id iv iv 

Pass Fail* Pass Fail* 


PRS: Adjustment to the Army 



i n nu hb n iv iv 


Pass Fail* Pais Fail* 


PRS: Working With Others 

3.8 - 


;/ 



I n nu HB mB IV IV 
n= 6,563 Pass Fail* p^, fail* 


BMT Restarts Disciplinary Incidents 



n = 263,752 Pass Fail* Pass Fail* n= 20,546 Pass Fail* Pass Fail* 

Note. * = Lowest scoring cognitive ability/TAPAS applicants screened out. Sample sizes vary based on availability 
of the outcome data. Findings related to TSC IV should be interpreted as preliminary due to low sample sizes. 

Figure 5.7. Tier 1 Soldier outcomes for selected IMT criteria by AFQT category and TAP AS 
pass/fail status. 
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Similar trends are visible when examining attrition outcomes as shown in Figure 5.8. Attrition 
for Tier 1 Soldiers in the IIIB and IV TAPAS Fail categories was greater than attrition for 
Soldiers in the TUB and IV TAPAS Pass categories at each of the time points. For Soldiers in 
Category IIIB, this difference ranged from 4.5% at 6 months to 5.6% at 24 months. Differences 
were smaller for Soldiers in Category IV, and ranged from 1.2% at 24 months to 3.2% at 12 
months. 


6-Month Attrition 


16.1% 


13.5% 


11 % 



„= 143.944 


n mA he he w iv 

Pass Fail* Pass Fail* 



Note. * = Lowest scoring cognitive ability/TAPAS applicants screened out. Sample sizes vary based on avaliability 
of attrition data. Findings related to TSC IV should be interpreted as preliminary due to low sample sizes. 

Figure 5.8. Tier 1 Soldier attrition by AFQT category and TAPAS pass/fail status. 


Figure 5.9 compares selected IMT criteria for Tier 2 TAPAS Pass and Fail Soldiers and all Tier 1 
Soldiers. Interpretation of findings involving Tier 2 TAPAS Fail Soldiers should be interpreted 
with caution due to small sample size. With the exception of IMT Restarts, Tier 2 TAPAS Pass 
Soldiers had more favorable outcomes than Tier 2 TAPAS Fail Soldiers. For example, average 
APFT scores were 13 points higher for Tier 2 TAPAS Pass than Fail Soldiers, and 7.2% more 
Tier 2 TAPAS Fail Soldiers had at least one Disciplinary Incident compared to Tier 2 TAPAS 
Pass Soldiers. In addition, Tier 2 TAPAS Pass Soldiers had more favorable outcomes with 
respect to Army Fit and Army Life Adjustment than Tier 1 Soldiers, and nearly identical APFT 
Scores and Disciplinary Incidents on average. 


As shown in Figure 5.10, Tier 2 TAPAS Pass Soldiers also had lower attrition rates than Tier 2 
TAPAS Fail Soldiers at 6, 12, and 24 months. These differences ranged from 2.1% lower 
attrition at 6 months to 3.3% at 24 months. Attrition for Tier 1 relative to Tier 2 Soldiers was 
lower at all three time points. 
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APFT Score 


260 


253 



Ed Tier 1 EdTier2Plss Ed Tier 2 Fail» 

n= 23,339 


Army Fit Army Life Adjustment 



n= 24,024 >1=24,024 


IMT Restarts 

11 . 0 % -|- 

© 
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EdTierl EdTi»2Pass EdTier2Fail* 


n=290,137 


Disciplinary Incidents 



Ed Tier 1 EdTier2Pass Ed Tier 2 Fail* 


«= 22,410 


Note. * = Lowest scoring TAPAS applicants screened out. Sample sizes vary based on avaliability of outcome data. 
Findings related to Tier 2 TAPAS Fail should be interpreted as preliminary due to low sample sizes. 

Figure 5.9. Comparison of Tier 2 applicant screen pass/fails with Tier 1 Soldiers on selected 
IMT outcomes. 
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6-Month Attrition 
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16.1% 
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k = 156,671 


12-Month Attrition 


36,0“. 


18.0% 


17.2% 
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Ed Tier 1 Ed Tier 2 Pass Ed Tier 2 Fail* 


«= 136.641 


24-Month Attrition 

52.0% t- 



■ 

Ed Her 1 EdTier2Pass Ed Tier 2 Fail* 


n= 87,701 


Note. * = Lowest scoring TAPAS applicants screened out. Sample sizes vary based on avaliability of attrition data. 
Findings related to Tier 2 TAPAS Fail should be interpreted as preliminary due to low sample sizes. 

Figure 5.10. Comparison of Tier 2 applicant screen pass/fails with Tier 1 Soldiers on attrition 
outcomes. 


To date, the in-unit TAPAS criterion validation has yielded very low sample sizes and 
preliminary findings are presented where possible. However, there were not enough Soldiers in 
each AFQT TSC to present pass/fail comparison charts for in-unit outcomes. What follows are 
selected findings that provide a brief overview of preliminary relationships with a variety of 
criteria. For the in-unit criteria of WTBD JKT, APFT Score, Army Fit, and PRS: Leadership 
Potential, we computed Soldiers’ mean performance scores by quintiles based on TAPAS 
percentile scores. Figure 5.11 presents the relationship between TAPAS scores and these selected 
in-unit criteria for Tier 1 Soldiers only. In general, Soldiers with higher TAPAS scores also had 
better performance outcomes. For WTBD JKT and APFT Score, the highest performers were 
Soldiers who also scored in the top 20 th percentile on the TAPAS. For Army Fit and PRS: 
Leadership Potential, Soldiers with the highest outcome scores were those scoring in the top 40 th 
TAPAS percentile. Moreover, Soldiers scoring in the bottom 20 th percentile on the TAPAS 
performed lowest as a group for every outcome examined, with particularly notable differences 
between Soldiers in the top and bottom TAPAS percentiles on WTBD JKT and APFT Score. 
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APFT Score 



Army Fit 
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(n = 2.831) TAP AS Percentile Score 
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1-20 21-40 41-60 61-80 81-100 1-20 21-40 41-60 61-80 81-100 

(n = 2,713) TAP AS Percentile Score (h = 2,208) TAP AS Percentile Scare 

Figure 5.11. Tier 1 Soldier outcomes for selected in-unit criteria by TAPAS percentile score 
categories. 


Summary 

This chapter summarized results from the tenth cycle of the evaluation of criterion-related 
validity in the TOPS IOT&E. Overall, the TAPAS composites demonstrated incremental validity 
over the AFQT in predicting first-term Soldier performance and retention. In particular, the 
TAPAS Will-Do composite demonstrated the greatest incremental validity overall, with A R 
estimates for eight IMT and four in-unit criteria meeting or exceeding .05. The TAPAS 
Adaptation composite also yielded incremental validity estimates above .05 for four IMT criteria 
and two in-unit criteria. In addition, both the Will-Do and Adaptation composites demonstrated 
negative relationships with the dichotomous criteria (i.e., attrition, disciplinary incidents, and 
IMT restarts). Higher scores on these composites were associated with a reduction in the 
likelihood of these outcomes. Conversely, the TAPAS Can-Do composite did not provide any 
notable incremental validity for the criteria examined here. This finding is not surprising given 
the established strength of the AFQT in the prediction of cognitively-based criteria. Furthermore, 
results of the implementation analyses provide support for the utility of TAPAS. For both IMT 
and attrition criteria, AFQT Category IIIB and IV Soldiers scoring among the top 90% on the 
TAPAS Will-Do composite have markedly better outcomes than those Category IIIB/IV Soldiers 
scoring among the bottom 10%, and they often possess scores in line with AFQT Category IIIA 
Soldiers. Additionally, in-unit criterion scores are consistently lowest for Soldiers whose TAPAS 
scores are among the bottom 20 th percentile. 
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CHAPTER 6: SUMMARY AND A LOOK AHEAD 


Deirdre J. Knapp, Bethany H. Bynum (HumRRO), Heather M.K. Wolters, & Tonia S. Heffner (ARI) 


Summary of the TOPS IOT&E Method 

In an effort to expand the basis on which applicants are evaluated for enlistment, the Army is 
conducting an initial operational test and evaluation (IOT&E) of the Tier One Performance 
Screen (TOPS). The TOPS assessment, the Tailored Adaptive Personality Assessment System 
(TAPAS), is being administered to non-prior service applicants testing at all MEPS locations. 

To evaluate the TAPAS, the Army is collecting criterion data on Soldiers at multiple points 
during their time in service. Some outcome data are available from administrative records, 
including training course grades, training completion rates, and separation status. Data on 
additional measures are collected from Soldiers in selected MOS as they complete IMT. These 
measures include job knowledge tests (JKTs), an attitudinal person-environment fit assessment 
(the Army Life Questionnaire; ALQ), and performance rating scales (PRS) completed by the 
Soldiers’ cadre members. Versions of the JKTs and the ALQ suited for Soldiers in their first 
enlistment term are also administered to Soldiers after they have joined their units. Performance 
ratings are collected from their supervisors at this time as well. Analysis datasets incorporating 
TAPAS and criterion data are constructed and cumulative validation analyses are being 
conducted at 6-month intervals throughout the IOT&E period. 

The latest analysis data file (December 2014) includes a total of 623,480 applicants who took the 
TAPAS. Of these, 573,146 were in the TOPS Applicant Sample. The Applicant Sample was 
determined by excluding Education Tier 3, AFQT Category V, and prior service applicants from 
the master data file. Of that Applicant Sample, 311,908 (54.4%) had a record in at least one of 
the administrative criterion data sources; 23,372 had IMT data collected from the schoolhouse 
and 3,105 had in-unit criterion data. 

Data from the JKTs, PRS, ALQ, and administrative sources were combined to yield an array of 
scores representing important Soldier outcomes. In general, the criterion scores exhibit 
acceptable psychometric properties and a sensible pattern of intercorrelations. The exception to 
this is the Army-wide and MOS-specific PRS, which continue to exhibit low interrater 
reliability. Despite the low reliabilities, the validation results show that variance in the ratings 
can be predicted. 


Summary of Evaluation Results to Date 

Evaluation results thus far suggest that the TAPAS holds promise for new Soldier selection. 
Results of the incremental validity analyses indicate that the TAPAS predicts important first- 
term criteria over and above the AFQT, especially measures tapping motivation-based aspects of 
Soldier performance, such as physical fitness, adjustment to Army life, commitment and fit, and 
discipline. Further, examination of AFQT categories and quintile splits of predictor composites 
show a clear improvement in favor of higher scoring individuals. Individuals in the lowest 


56 



category performed the worst. These findings are consistent with past evaluations in this series 
(Bynum & Mullins, 2015; Knapp & Heffner, 2011, 2012; Knapp et al., 2011; Knapp & LaPort, 
2013a, 2013b, 2014) and the original research that led Aimy policy-makers to select TAP AS for the 
TOPS IOT&E (Knapp & Heffner, 2010). 

The Will-Do composite was associated with the greatest incremental validity gains compared to 
other TAP AS composites. This was especially true for the prediction of physical fitness, Will Do 
Performance, and Army Life Adjustment. When examining outcomes by AFQT category, a clear 
distinction was seen when comparing the IIIB and IV TAPAS Pass groups and the IIIB and IV 
TAPAS Fail groups. For a number of outcomes, including disciplinary incidents, training 
restarts, and attrition, more favorable outcomes were observed for the TAPAS Pass compared to 
the corresponding Fail groups. The Adaptation composite generally provided small incremental 
validity gains in attrition, with Adaptation showing larger gains for higher months in service. 
Even these small gains in validity are important, particularly given the modest relationship with 
the AFQT. Results showed consistently higher attrition among the TUB and IV TAPAS Fail 
AQFT categories. 


Looking Ahead 


Changes to Predictor Measures 

In September of 2013, a third series of new adaptive forms of the TAPAS were introduced at the 
MEPS. Each form measures 13 dimensions. Each of the three new forms assesses the same 10 core 
dimensions, plus three of seven experimental dimensions. The seven experimental dimensions 
assessed vary by version. In total, the newer versions of the TAPAS collectively measure 17 
dimensions. The experimental dimensions will be evaluated for potential use in revised or new 
TAPAS composites once sufficient data are available. 

Analyses 

Analyses will continue on the current semi-annual cycle to evaluate basic psychometric 
properties of the assessments, validation, and incremental validation analyses. Additional 
analyses may include evaluation of the experimental TAPAS facets for potential use in revised or 
new TAPAS composites, or an alternative approach for modeling MOS classification outcomes. 
We will continue to update or to modify our evaluation analysis plans as the Army’s goals for 
the TOPS IOT&E evolve or to better meet the informational needs of Army stakeholders. 

Related Research 

In addition to the evaluation described in this report, non-cognitive assessments are being 
examined to determine their prediction potential for MOS assignment. Temperament measures as 
well as interest inventories predicted attrition and job attitudes for a subset of MOS included in 
the research (Ingerick et al., 2009; Knapp et al., 2012). TAPAS data of Soldiers in four MOS 
were analyzed along with a wide variety of important outcomes (including Army-wide job 
knowledge, attrition, disciplinary incidents, training restarts, and APFT score) and determined 
that approximately 40-45% of the Soldiers were predicted to perform better if they had been 
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assigned to one of the other three MOSs (Nye et al., 2012). Ongoing research continues to pursue 
the utility of TAPAS as an assignment tool. 

Conclusion 

Inclusion of non-cognitive measures in initial entry screening allows the Army to predict a 
broader range of valued Army outcomes than traditional cognitive ability and educational 
credential screening. The TAPAS test, specifically, demonstrates the ability to predict an 
expanded concept of Soldier performance to include motivation, disciplinary behavior, 
adaptability, adjustment to military life, and attrition. Indeed, the TAPAS predicts these 
outcomes over and above the AFQT. Thus, TAPAS provides unique and valuable information 
regarding a recruit’s potential success as a Soldier that is not captured elsewhere in the accession 
process. Additional research should continue to refine and expand the prediction potential of 
TAPAS and other non-cognitive measures. 
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APPENDIX A 


PREDICTOR MEASURE PSYCHOMETRIC PROPERTIES IN THE 

APPLICANT SAMPLE 


Table A.l. Mean and Standard Deviations for the TAP AS Composites and TAP AS Scales on 
the 15-Dimension Forms (June 2009-September 2013) 

15D-Static/CAT v4/5/7/8 


Tier 1+2 

(Combined) Tier 1 Tier 2 


TAPAS Composite/ 

(n = 100,282-418,682) 

(n = 94,347-396,212) 

(n = 5,786-22,470) 

TAPAS Scale 

M 

SD 

M 

SD 

M 

SD 

Individual TAPAS Scales " 

Achievement 

-.01 

.98 

-.01 

.98 

.07 

.98 

Adjustment 

-.02 

.98 

-.03 

.98 

.12 

.96 

Adventure Seeking 

-.06 

.98 

-.06 

.98 

.00 

.98 

Attention Seeking 

-.04 

.98 

-.04 

.98 

-.02 

1.00 

Commitment to Serve 

.00 

.98 

-.01 

.98 

.20 

.94 

Cooperation 

.01 

.98 

.02 

.98 

-.02 

.98 

Courage 

-.02 

.98 

-.03 

.98 

.14 

.97 

Dominance 

-.02 

.98 

-.02 

.98 

-.08 

1.00 

Even Tempered 

.01 

.98 

.00 

.98 

.15 

.99 

Intellectual Efficiency 

-.02 

.97 

-.02 

.98 

.10 

.95 

Non-Delinquency 

.03 

.98 

.04 

.98 

-.06 

1.02 

Optimism 

.00 

.98 

.00 

.98 

-.01 

.98 

Order 

.01 

.98 

.01 

.98 

-.01 

.97 

Physical Conditioning 

.01 

.98 

.02 

.98 

-.17 

.95 

Responsibility 

.00 

.98 

-.01 

.98 

.07 

.99 

Self-Control 

.00 

.98 

-.01 

.98 

.12 

.98 

Selflessness 

.01 

.98 

.01 

.98 

-.02 

.99 

Situational Awareness 

-.03 

.98 

-.04 

.98 

.13 

.98 

Sociability 

-.01 

.98 

-.01 

.98 

-.02 

.99 

Team Orientation 

-.01 

.99 

-.01 

.99 

.01 

1.03 

Tolerance 

.00 

.98 

-.01 

.98 

.04 

.97 

TAPAS Composites 

Can-Do 

99.80 

20.93 

99.70 

20.96 

101.86 

20.16 

Will-Do 

99.91 

19.17 

100.02 

19.19 

97.96 

18.70 

Adaptation 

100.19 

19.57 

100.27 

19.61 

98.67 

18.93 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, and AFQT >10) with 
valid TAP AS score data. 

a Sample sizes vary as a result of TAP AS scales not being administered in every version. 
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Table A. 2. Mean and Standard Deviations for the TAP AS Composites and TAP AS Scales on 
13D-CAT-v9 (September 2013-September 2014) 





13D-CAT v9 



TAPAS Composite/ 

Tier 1+2 
(Combined) 

(» = 44,816) 

(n -- 

Tier 1 
= 42,078) 

(n 

Tier 2 
= 2,738) 

TAPAS Scale 

M 

SD 

M 

SD 

M 

SD 

Individual TAPAS Scales " 

Achievement 

.01 

.99 

.00 

.98 

.16 

.98 

Adjustment 

- 

- 

- 

- 

- 

- 

Adventure Seeking 

- 

- 

- 

- 

- 

- 

Attention Seeking 

- 

- 

- 

- 

- 

- 

Commitment to Serve 

-.02 

.98 

-.03 

.98 

.20 

.90 

Cooperation 

.04 

.99 

.04 

.99 

.04 

.98 

Courage 

- 

- 

- 

- 

- 

- 

Dominance 

.02 

.98 

.02 

.98 

.00 

.99 

Even Tempered 

.06 

1.00 

.05 

1.00 

.28 

1.01 

Intellectual Efficiency 

.04 

.98 

.03 

.98 

.19 

.95 

Non-Delinquency 

- 

- 

- 

- 

- 

- 

Optimism 

.02 

1.00 

.01 

1.00 

.04 

1.00 

Order 

-.02 

.97 

-.02 

.97 

-.07 

.97 

Physical Conditioning 

-.03 

1.01 

-.02 

1.02 

-.15 

.97 

Responsibility 

.03 

.99 

.02 

.99 

.13 

1.01 

Self-Control 

- 

- 

- 

- 

- 

- 

Selflessness 

.08 

1.01 

.09 

1.01 

.02 

1.03 

Situational Awareness 

- 

- 

- 

- 

- 

- 

Sociability 

.08 

1.02 

.08 

1.02 

.14 

1.03 

Team Orientation 

- 

- 

- 

- 

- 

- 

Tolerance 

.07 

.99 

.06 

.99 

.20 

.98 

TAPAS Composites 

Can-Do 

100.11 

19.65 

99.91 

19.64 

103.12 

19.52 

Will-Do 

99.92 

20.22 

99.95 

20.25 

99.57 

19.71 

Adaptation 

99.69 

20.03 

99.69 

20.09 

99.57 

19.01 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, and AFQT >10) with 
valid TAP AS score data. 

a Not all TAP AS scales were administered in every version; missing M and SD indicate that the scale was not administered. 
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Table A. 3. Mean and Standard Deviations for the TAP AS Composites and TAP AS Scales on 
13D-CAT-vlO (September 2013-September 2014) 





13D-CAT vlO 



TAPAS Composite/ 

Tier 1+2 
(Combined) 

(« = 44,821) 

(n 

Tier 1 
= 42,194) 

(n 

Tier 2 
= 2,627) 

TAPAS Scale 

M 

SD 

M 

SD 

M 

SD 

Individual TAPAS Scales " 

Achievement 

-.01 

.98 

-.02 

.98 

.15 

.98 

Adjustment 

- 

- 

- 

- 

- 

- 

Adventure Seeking 

- 

- 

- 

- 

- 

- 

Attention Seeking 

- 

- 

- 

- 

- 

- 

Commitment to Serve 

- 

- 

- 

- 

- 

- 

Cooperation 

- 

- 

- 

- 

- 

- 

Courage 

.01 

.99 

.00 

.99 

.24 

.96 

Dominance 

-.01 

.98 

-.01 

.98 

-.02 

.95 

Even Tempered 

.02 

1.00 

.01 

1.00 

.25 

.99 

Intellectual Efficiency 

.01 

.96 

.00 

.96 

.19 

.91 

Non-Delinquency 

.05 

.98 

.05 

.98 

.08 

1.04 

Optimism 

.03 

.98 

.03 

.98 

.03 

.98 

Order 

-.02 

.98 

-.02 

.98 

-.06 

.97 

Physical Conditioning 

-.02 

.99 

-.02 

.99 

-.14 

.94 

Responsibility 

- 

- 

- 

- 

- 

- 

Self-Control 

- 

- 

- 

- 

- 

- 

Selflessness 

.09 

1.00 

.09 

1.00 

.06 

1.03 

Situational Awareness 

-.03 

.99 

-.04 

.99 

.20 

.99 

Sociability 

.09 

1.03 

.08 

1.02 

.21 

1.06 

Team Orientation 

- 

- 

- 

- 

- 

- 

Tolerance 

.07 

1.00 

.06 

.99 

.15 

.99 

TAPAS Composites 

Can-Do 

99.42 

19.68 

99.22 

19.70 

102.56 

19.19 

Will-Do 

99.69 

19.62 

99.71 

19.67 

99.50 

18.89 

Adaptation 

99.40 

19.84 

99.43 

19.90 

98.92 

18.81 


Note. Results are limited to the TOPS Applicant Sample (non-prior service. Education Tier 1 and 2, and AFQT >10) with 
valid TAP AS score data. 

a Not all TAP AS scales were administered in every version; missing M and SD indicate that the scale was not administered. 
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Table A. 4. Mean and Standard Deviations for the TAP AS Composites and TAP AS Scales on 
13D-CAT-vll (September 2013-September 2014) 





13D-CAT vl 1 



TAPAS Composite/ 

Tier 1+2 
(Combined) 

(n = 45,378) 

(n 

Tier 1 
= 42,738) 

(n 

Tier 2 
= 2,640) 

TAPAS Scale 

M 

SD 

M 

SD 

M 

SD 

Individual TAPAS Scales " 

Achievement 

.01 

1.00 

.00 

.99 

.17 

1.02 

Adjustment 

- 

- 

- 

- 

- 

- 

Adventure Seeking 

- 

- 

- 

- 

- 

- 

Attention Seeking 

.05 

.99 

.04 

.99 

.13 

1.02 

Commitment to Serve 

.01 

.99 

.00 

.99 

.22 

.94 

Cooperation 

- 

- 

- 

- 

- 

- 

Courage 

- 

- 

- 

- 

- 

- 

Dominance 

.00 

.99 

.00 

.99 

.00 

1.02 

Even Tempered 

.06 

1.00 

.05 

1.00 

.23 

1.02 

Intellectual Efficiency 

.04 

.97 

.03 

.97 

.21 

.95 

Non-Delinquency 

- 

- 

- 

- 

- 

- 

Optimism 

.03 

.99 

.03 

.99 

.01 

1.02 

Order 

.00 

.98 

.00 

.98 

.01 

.97 

Physical Conditioning 

-.01 

1.01 

.00 

1.01 

-.12 

.97 

Responsibility 

- 

- 

- 

- 

- 

- 

Self-Control 

- 

- 

- 

- 

- 

- 

Selflessness 

.06 

1.01 

.07 

1.01 

-.01 

1.01 

Situational Awareness 

- 

- 

- 

- 

- 

- 

Sociability 

.07 

1.00 

.07 

1.00 

.13 

1.03 

Team Orientation 

.06 

1.01 

.06 

1.01 

.10 

1.07 

Tolerance 

.07 

.99 

.07 

.99 

.18 

.97 

TAPAS Composites 

Can-Do 

100.04 

19.65 

99.86 

19.67 

102.93 

19.13 

Will-Do 

100.11 

20.31 

100.12 

20.31 

99.97 

20.28 

Adaptation 

99.92 

19.79 

99.97 

19.84 

99.11 

18.80 


Note. Results are limited to the TOPS Applicant Sample (non-prior service. Education Tier 1 and 2, and AFQT >10) with 
valid TAP AS score data. 

a Not all TAP AS scales were administered in every version; missing M and SD indicate that the scale was not administered. 
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Table A.5. Correlations between TAPAS Composites and TAPAS Scales with AFQT in the 
TOPS Applicant Sample by Version 

15D-Static/CAT v4/5/7/8 13D-CAT v9/10/ll 

_ (June 2009-September 2013) _ (September 2013-September 2014) 


TAPAS Composite/ Tier 1+ 2 Tier 1+ 2 


TAPAS Scale 

(Combined) 

Tier 1 

Tier 2 

(Combined) 

Tier 1 

Tier 2 

n 

100,282- 

94,347- 

5,786- 

44,816- 

42,078- 

2,627- 

418,682 

396,212 

22,470 

135,015 

127,010 

8,005 

Individual TAPAS Scales “ 

Achievement 

.06 

.06 

.01 

.05 

.05 

.03 

Adjustment 

.12 

.12 

.11 

- 

- 

- 

Adventure Seeking 

.10 

.10 

.05 

- 

- 

- 

Attention Seeking 

.05 

.05 

.03 

.00 

.00 

.02 

Commitment to Serve 

-.14 

-.14 

-.06 

-.14 

-.14 

-.08 

Cooperation 

-.06 

-.06 

-.04 

-.12 

-.12 

-.10 

Courage 

.06 

.06 

.04 

.10 

.11 

.07 

Dominance 

.10 

.11 

.02 

.12 

.12 

.03 

Even Tempered 

.09 

.09 

.09 

.08 

.08 

.10 

Intellectual Efficiency 

.35 

.35 

.30 

.29 

.29 

.25 

Non-Delinquency 

-.04 

-.04 

-.01 

-.06 

-.06 

-.04 

Optimism 

.06 

.07 

.04 

.10 

.10 

.07 

Order 

-.17 

-.17 

-.16 

-.15 

-.15 

-.14 

Physical Conditioning 

.05 

.05 

-.01 

.05 

.05 

-.02 

Responsibility 

.15 

.15 

.09 

.14 

.14 

.09 

Self-Control 

-.02 

-.02 

.00 

- 

- 

- 

Selflessness 

-.07 

-.07 

-.08 

-.06 

-.06 

-.08 

Situational Awareness 

.01 

.01 

.03 

.03 

.03 

.02 

Sociability 

-.10 

-.10 

-.08 

-.12 

-.12 

-.06 

Team Orientation 

-.10 

-.11 

-.09 

-.08 

-.08 

-.02 

Tolerance 

.03 

.03 

.03 

.08 

.08 

.08 

TAPAS Composites 

Can-Do 

.43 

.44 

.38 

.35 

.35 

.29 

Will-Do 

.10 

.10 

.01 

.10 

.11 

.02 

Adaptation 

.17 

.17 

.11 

.18 

.19 

.11 


Note. Results are limited to the TOPS Applicant Sample (non-prior service. Education Tier 1 and 2, AFQT Category IV and above) 
with valid TAPAS score data. Correlations in bold are statistically significant,/) < .01 (two-tailed). 

a Not all TAPAS scales were administered in every version; missing M and SD indicate that the scale was not administered. 
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Table A. 6. Basic Descriptive Statistics for AFQT, ASVAB Subtests, and Aptitude Area (AA) Composites by Version in the TOPS 


Applicant Sample 

Composite/Subtest 


15D-Static/CAT v4/5/7/8 
(June 2009-September 2013) 



13D-CAT V9/10/11 
(September 2013-September 2014) 


n 

M 

SD 

Min 

Max 

n 

M 

SD 

Min 

Max 

AFQT 

418,682 

54.53 

22.59 

10 

99 

135,015 

52.22 

22.20 

10 

99 

ASVAB Subtests 











Arithmetic Reasoning (AR) 

418,620 

51.78 

7.64 

21 

72 

135,013 

50.92 

7.70 

21 

72 

Assembling Objects (AO) 

401,416 

54.62 

7.82 

25 

70 

126,509 

54.21 

7.83 

25 

68 

Auto & Shop Information (AS) 

418,617 

48.55 

9.21 

20 

86 

135,012 

46.62 

8.80 

20 

86 

Electronics Information (El) 

418,618 

50.90 

9.00 

15 

84 

135,013 

49.45 

9.00 

16 

84 

General Science (GS) 

418,620 

50.99 

8.29 

19 

76 

135,013 

50.26 

8.31 

20 

76 

Math Knowledge (MK) 

418,620 

53.24 

6.80 

25 

73 

135,013 

53.25 

6.71 

25 

73 

Mechanical Comprehension (MC) 

418,617 

52.40 

8.33 

23 

82 

135,012 

51.19 

8.15 

23 

82 

Paragraph Comprehension (PC) 

418,620 

52.23 

6.90 

21 

69 

135,013 

51.54 

6.84 

23 

69 

Word Knowledge (WK) 

418,620 

50.48 

7.83 

16 

76 

135,013 

49.40 

7.73 

16 

76 

Aptitude Area (AA) Composites 











Clerical (CL) 

418,642 

104.30 

13.54 

50 

153 

135,011 

102.61 

13.38 

46 

152 

Combat (CO) 

418,642 

103.71 

14.49 

51 

160 

135,011 

101.44 

14.19 

56 

161 

Electronics (EL) 

418,642 

103.44 

14.48 

52 

160 

135,011 

101.05 

14.20 

57 

161 

Field Artillery (FA) 

418,642 

103.90 

14.42 

51 

160 

135,011 

101.67 

14.13 

56 

159 

General Maintenance (GM) 

418,642 

103.03 

14.97 

48 

162 

135,011 

100.49 

14.66 

53 

162 

General Technical (GT) 

418,646 

103.20 

13.99 

46 

149 

135,013 

101.24 

13.86 

43 

149 

Mechanical Maintenance (MM) 

418,642 

101.78 

15.97 

46 

167 

135,011 

98.63 

15.49 

49 

168 

Operators and Food Service (OF) 

418,642 

102.98 

14.94 

50 

161 

135,011 

100.35 

14.61 

55 

161 

Surveillance and Communications (SC) 

418,642 

104.00 

14.10 

52 

159 

135,011 

101.87 

13.85 

54 

159 

Skilled Technical (ST) 

418,642 

103.87 

14.11 

51 

158 

135,011 

101.75 

13.86 

52 

157 

Note. Results are limited to the TOPS Applicant Sample (non-prior service. Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data. 
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Table A.7. Basic Descriptive Statistics for AFQT, ASVAB Subtests, and Aptitude Area (AA) Composites in the 15-Dimension 
Forms by Education Tier 





Tier 1 





Tier 2 



Composite/Subtest 

n 

M 

SD 

Min 

Max 

n 

M 

SD 

Min 

Max 

AFQT 

396,212 

54.63 

22.78 

10 

99 

22,470 

52.84 

18.79 

10 

99 

ASVAB Subtests 

Arithmetic Reasoning (AR) 

396,164 

51.80 

7.71 

21 

72 

22,456 

51.48 

6.40 

24 

72 

Assembling Objects (AO) 

379,798 

54.62 

7.83 

25 

70 

21,618 

54.50 

7.63 

26 

69 

Auto & Shop Information (AS) 

396,161 

48.40 

9.21 

20 

86 

22,456 

51.22 

8.89 

22 

82 

Electronics Information (El) 

396,162 

50.82 

9.05 

15 

84 

22,456 

52.39 

7.94 

18 

83 

General Science (GS) 

396,164 

50.98 

8.36 

19 

76 

22,456 

51.18 

7.02 

20 

76 

Math Knowledge (MK) 

396,164 

53.43 

6.81 

25 

73 

22,456 

49.76 

5.57 

26 

73 

Mechanical Comprehension (MC) 

396,161 

52.35 

8.37 

23 

82 

22,456 

53.27 

7.55 

23 

79 

Paragraph Comprehension (PC) 

396,164 

52.20 

6.94 

22 

69 

22,456 

52.80 

6.06 

21 

69 

Word Knowledge (WK) 

396,164 

50.43 

7.89 

16 

76 

22,456 

51.33 

6.62 

21 

76 

Aptitude Area (AA) Composites 

Clerical (CL) 

396,178 

104.37 

13.68 

50 

153 

22,464 

102.99 

10.74 

56 

145 

Combat (CO) 

396,178 

103.72 

14.62 

53 

160 

22,464 

103.42 

11.91 

51 

154 

Electronics (EL) 

396,178 

103.42 

14.62 

52 

160 

22,464 

103.67 

11.85 

52 

153 

Field Artillery (FA) 

396,178 

103.92 

14.55 

53 

160 

22,464 

103.54 

11.80 

51 

154 

General Maintenance (GM) 

396,178 

103.00 

15.10 

51 

162 

22,464 

103.59 

12.46 

48 

155 

General Technical (GT) 

396,182 

103.17 

14.12 

46 

149 

22,464 

103.73 

11.31 

54 

145 

Mechanical Maintenance (MM) 

396,178 

101.65 

16.07 

48 

167 

22,464 

104.01 

13.96 

46 

158 

Operators and Food Service (OF) 

396,178 

102.92 

15.07 

52 

161 

22,464 

103.91 

12.45 

50 

154 

Surveillance and Communications (SC) 

396,178 

104.03 

14.24 

52 

159 

22,464 

103.44 

11.37 

54 

153 

Skilled Technical (ST) 

396,178 

103.88 

14.25 

51 

158 

22,464 

103.65 

11.37 

56 

150 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data. 
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Table A. 8. Basic Descriptive Statistics for AFQT, ASVAB Subtests, and Aptitude Area (AA) Composites in Version 9, 10, and 11 by 
Education Tier 





Tier 1 





Tier 2 



Composite/Subtest 

n 

M 

SD 

Min 

Max 

n 

M 

SD 

Min 

Max 

AFQT 

127,010 

52.35 

22.40 

10 

99 

8,005 

50.17 

18.60 

10 

99 

ASVAB Subtests 

Arithmetic Reasoning (AR) 

127,008 

50.95 

7.77 

21 

72 

8,005 

50.43 

6.38 

24 

72 

Assembling Objects (AO) 

118,787 

54.22 

7.84 

25 

68 

7,722 

53.94 

7.72 

27 

68 

Auto & Shop Information (AS) 

127,007 

46.42 

8.77 

20 

86 

8,005 

49.77 

8.68 

24 

82 

Electronics Information (El) 

127,008 

49.34 

9.04 

16 

84 

8,005 

51.23 

8.00 

19 

80 

General Science (GS) 

127,008 

50.26 

8.38 

20 

76 

8,005 

50.24 

7.21 

24 

76 

Math Knowledge (MK) 

127,008 

53.50 

6.70 

25 

73 

8,005 

49.24 

5.49 

27 

72 

Mechanical Comprehension (MC) 

127,007 

51.13 

8.19 

23 

82 

8,005 

52.22 

7.37 

25 

78 

Paragraph Comprehension (PC) 

127,008 

51.50 

6.90 

23 

69 

8,005 

52.21 

5.94 

29 

69 

Word Knowledge (WK) 

127,008 

49.32 

7.78 

16 

76 

8,005 

50.56 

6.74 

24 

76 

Aptitude Area (AA) Composites 

Clerical (CL) 

127,006 

102.70 

13.52 

46 

152 

8,005 

101.07 

10.61 

64 

140 

Combat (CO) 

127,006 

101.46 

14.33 

56 

161 

8,005 

101.08 

11.76 

61 

147 

Electronics (EL) 

127,006 

101.03 

14.34 

57 

161 

8,005 

101.34 

11.71 

65 

148 

Field Artillery (FA) 

127,006 

101.70 

14.28 

56 

159 

8,005 

101.23 

11.64 

62 

146 

General Maintenance (GM) 

127,006 

100.45 

14.80 

53 

162 

8,005 

101.09 

12.32 

61 

150 

General Technical (GT) 

127,008 

101.20 

14.01 

43 

149 

8,005 

101.82 

11.25 

65 

145 

Mechanical Maintenance (MM) 

127,006 

98.47 

15.58 

49 

168 

8,005 

101.25 

13.75 

58 

156 

Operators and Food Service (OF) 

127,006 

100.28 

14.74 

55 

161 

8,005 

101.41 

12.28 

63 

150 

Surveillance and Communications (SC) 

127,006 

101.91 

14.00 

54 

159 

8,005 

101.26 

11.22 

65 

145 

Skilled Technical (ST) 

127,006 

101.77 

14.01 

52 

157 

8,005 

101.49 

11.24 

67 

144 


Note. Results are limited to the TOPS Applicant Sample (non-prior service. Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data. 
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Table A. 9. Correlations among TAP AS Scale Scores in the Applicant Sample 


TAPAS Scale 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

1 . 

Achievement 





















2. 

Adjustment 

.10 




















3. 

Adventure Seeking 

.10 

.15 



















4. 

Attention Seeking 

.04 

.11 

.17 


















5. 

Commitment to Serve 

.18 

.05 

.04 

.01 

















6. 

Cooperation 

.10 

.07 

-.14 

-.03 

.05 
















7. 

Courage 

.23 

.16 

- 

.10 

- 

- 















8. 

Dominance 

.31 

.10 

.13 

.23 

.10 

-.06 

.23 














9. 

Even Tempered 

.12 

.22 

-.05 

-.04 

.10 

.29 

.07 

-.03 













10. 

Intellectual Efficiency 

.27 

.19 

.07 

.09 

.06 

.00 

.21 

.28 

.11 












11. 

Non-Delinquency 

.20 

.01 

-.17 

-.14 

.12 

.23 

.05 

-.02 

.23 

.04 











12. 

Optimism 

.16 

.25 

.02 

.09 

.07 

.14 

.05 

.13 

.19 

.12 

.12 










13. 

Order 

.19 

-.07 

-.08 

-.05 

.08 

.07 

.02 

.08 

.02 

.08 

.13 

.02 









14. 

Physical Conditioning 

.19 

.05 

.25 

.10 

.06 

-.05 

.13 

.18 

-.07 

.06 

-.05 

.05 

.06 








15. 

Responsibility 

.34 

.12 

- 

-.05 

.14 

.16 

.15 

.19 

.19 

.20 

.23 

.18 

.19 

.07 







16. 

Self-Control 

.23 

.09 

- 

-.10 

- 

.14 

.09 

.05 

.22 

.17 

.26 

.09 

.19 

-.04 

.22 






17. 

Selflessness 

.15 

-.04 

-.04 

-.06 

.08 

.22 

.10 

.05 

.13 

.02 

.17 

.08 

.08 

-.02 

.24 

.09 





18. 

Situational Awareness 

.21 

.15 

.10 

.04 

.07 

.00 

.20 

.13 

.13 

.27 

.13 

.09 

.17 

.07 

- 

- 

.05 




19. 

Sociability 

.09 

.10 

- 

.34 

.15 

.14 

.10 

.23 

.05 

.07 

-.02 

.16 

-.01 

.06 

.06 

-.07 

.13 

.04 



20. 

Team Orientation 

.09 

.05 

- 

.13 

.12 

- 

.03 

.11 

.08 

-.02 

.05 

.07 

.05 

.07 

.02 

.05 

.20 

- 

.24 


21. 

Tolerance 

.10 

.03 

— 

.04 

.08 

.14 

.06 

.05 

.15 

.12 

.07 

.09 

.03 

-.05 

.10 

.11 

.28 

.11 

.16 

.10 


Note. Results are limited to the Applicant Sample (Non-prior service. Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data, n = 44,816 - 553,697. Not all 
TAP AS scales were administered in every version; missing correlations indicate that the scales were not administered on the same version. The correlation between the Can-Do and Will- 
Do predictor composites is r = .18; the correlation between the Can-Do and Adaptation predictor composites is r = .40; the correlation between the Will-Do and Adaptation predictor 


composites is r = .53. All correlations among the predictor composites are statistically significant at p < .01 (two-tailed). Correlations in bold in table are statistically significant, p < .01 
(two-tailed). 
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Table A.10. Correlations among TAPAS Scale Scores in the Applicant Sample by Education Tier 



TAPAS Scale 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

21 

1 

Achievement 


.09 

.09 

.06 

.20 

.10 

.23 

.29 

.13 

.26 

.24 

.16 

.20 

.20 

.35 

.24 

.16 

.22 

.10 

.12 

.09 

2 

Adjustment 

.10 


.11 

.12 

.04 

.08 

.13 

.07 

.21 

.17 

.05 

.26 

-.05 

.03 

.12 

.11 

-.02 

.14 

.10 

.04 

.05 

3 

Adventure Seeking 

.10 

.15 


.20 

.08 

-.15 

— 

.15 

-.09 

.07 

-.15 

.01 

-.05 

.23 

— 

— 

-.03 

.10 

— 

— 

— 

4 

Attention Seeking 

.04 

.11 

.17 


.05 

-.03 

.12 

.23 

-.04 

.09 

-.10 

.08 

-.04 

.09 

-.05 

-.09 

-.05 

.04 

.36 

.15 

.06 

5 

Commitment to Serve 

.17 

.05 

.04 

.01 


.06 

— 

.12 

.11 

.08 

.12 

.08 

.09 

.10 

.19 

— 

.09 

.08 

.16 

.16 

.08 

6 

Cooperation 

.10 

.07 

-.14 

-.03 

.05 


- 

-.06 

.29 

.01 

.25 

.15 

.07 

-.05 

.15 

.15 

.22 

-.01 

.15 

— 

.13 

7 

Courage 

.23 

.16 

- 

.10 

— 

- 


.22 

.05 

.20 

.09 

.06 

.02 

.13 

.17 

.11 

.08 

.17 

.09 

.02 

.04 

8 

Dominance 

.31 

.10 

.13 

.23 

.10 

-.06 

.23 


-.05 

.25 

.00 

.09 

.10 

.18 

.17 

.05 

.02 

.13 

.23 

.13 

.02 

9 

Even Tempered 

.12 

.22 

-.04 

-.04 

.09 

.29 

.07 

-.03 


.10 

.28 

.22 

.02 

-.08 

.20 

.23 

.14 

.10 

.08 

.11 

.14 

10 

Intellectual Efficiency 

.27 

.19 

.07 

.09 

.06 

.00 

.20 

.28 

.11 


.07 

.10 

.10 

.07 

.20 

.18 

.02 

.27 

.06 

.00 

.10 

11 

Non-Delinquency 

.20 

.01 

-.17 

-.15 

.12 

.23 

.05 

-.02 

.23 

.04 


.17 

.13 

-.04 

.28 

.30 

.20 

.13 

.02 

.09 

.11 

12 

Optimism 

.17 

.25 

.02 

.09 

.07 

.14 

.05 

.13 

.19 

.12 

.12 


.01 

.04 

.16 

.10 

.11 

.11 

.16 

.08 

.10 

13 

Order 

.19 

-.07 

-.09 

-.05 

.08 

.07 

.02 

.08 

.02 

.08 

.13 

.02 


.12 

.24 

.19 

.10 

.15 

-.02 

.10 

.02 

14 

Physical Conditioning 

.19 

.06 

.25 

.10 

.06 

-.05 

.13 

.18 

-.07 

.06 

-.05 

.05 

.06 


.07 

-.01 

.00 

.08 

.04 

.04 

-.04 

15 

Responsibility 

.34 

.12 

- 

-.05 

.14 

.16 

.15 

.19 

.18 

.20 

.23 

.18 

.19 

.07 


.25 

.24 

- 

.07 

.04 

.10 

16 

Self-Control 

.23 

.09 

— 

-.10 

— 

.14 

.09 

.05 

.22 

.17 

.26 

.09 

.19 

-.04 

.22 


.09 

— 

-.06 

.07 

.10 

17 

Selflessness 

.15 

-.04 

-.04 

-.06 

.08 

.22 

.11 

.05 

.13 

.02 

.17 

.08 

.08 

-.02 

.24 

.09 


.04 

.13 

.23 

.25 

18 

Situational 

Awareness 

.21 

.15 

.10 

.04 

.07 

.00 

.20 

.13 

.12 

.27 

.13 

.09 

.17 

.07 



.05 


-.02 


.03 

19 

Sociability 

.09 

.10 

- 

.34 

.15 

.14 

.10 

.23 

.05 

.07 

-.02 

.16 

-.01 

.06 

.06 

-.07 

.13 

.04 


.26 

.17 

20 

Team Orientation 

.09 

.05 

- 

.13 

.12 

— 

.02 

.11 

.08 

-.02 

.05 

.07 

.05 

.07 

.02 

.05 

.19 

— 

.24 


.11 

21 

Tolerance 

.10 

.03 

— 

.04 

.08 

.14 

.06 

.05 

.15 

.12 

.07 

.09 

.03 

-.05 

.10 

.11 

.29 

.11 

.16 

.10 



Note. Results are limited to the Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) with valid TAPAS score data. Correlations below the 
diagonal are for Education Tier 1 applicants, n = 42,078-523,222. Correlations above the diagonal are for Education Tier 2 applicants, n = 2,627-30,475. Not all TAPAS scales 
were administered in every version; missing correlations indicate that the scales were not administered on the same version. For Tier 1 applicants, the correlation between the Can- 
Do and Will-Do predictor composites is r = .19; the correlation between the Can-Do and Adaptation predictor composites is r = .40; the correlation between the Will-Do and 
Adaptation predictor composites is r = .53. For Tier 2 applicants, the correlation between Can-Do and Will-Do predictor composites is r = .17; the correlation between the Can-Do 
and Adaptation predictor composites is r = .41; the correlation between the Will-Do and Adaptation predictor composites is r= .51. All correlations among the predictor 
composites are statistically significant at p < .01 (two-tailed). Correlations in bold in table are statistically significant, p < .01 (two-tailed). 
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Table A.ll. Correlations among AFQT, ASVAB Subtests, and AA Composite Scores in the TOPS Applicant Sample 


Composite/Subtest 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

1 

AFQT 

ASVAB Subtests 




















2 

Arithmetic Reasoning (AR) 

.81 



















3 

Assembling Objects (AO) 

.43 

.46 


















4 

Auto & Shop Info (AS) 

.37 

.31 

.26 

















5 

Electronics Information (El) 

.59 

.46 

.34 

.67 
















6 

General Science (GS) 

.73 

.53 

.35 

.50 

.67 















7 

Math Knowledge (MK) 

.71 

.68 

.37 

.06 

.28 

.41 














8 

Mech Comprehension (MC) 

.65 

.59 

.51 

.62 

.68 

.66 

.39 













9 

Para Comprehension (PC) 

.79 

.53 

.34 

.35 

.52 

.63 

.40 

.53 












10 

Word Knowledge (WK) 

Aptitude Area (AA) Composites 

.80 

.46 

.28 

.41 

.59 

.71 

.32 

.54 

.69 











11 

Clerical (CL) 

.96 

.90 

.49 

.43 

.63 

.72 

.76 

.71 

.74 

.73 










12 

Combat (CO) 

.88 

.78 

.50 

.67 

.78 

.80 

.66 

.85 

.69 

.71 

.94 









13 

Electronics (EL) 

.90 

.79 

.49 

.67 

.80 

.79 

.63 

.83 

.72 

.75 

.95 

1.0 








14 

Field Artillery (FA) 

.89 

.81 

.51 

.65 

.76 

.79 

.67 

.85 

.69 

.70 

.95 

1.0 

.99 







15 

General Maintenance (GM) 

.85 

.78 

.49 

.73 

.82 

.80 

.59 

.84 

.67 

.69 

.91 

.99 

.99 

.99 






16 

General Technical (GT) 

.96 

.88 

.45 

.42 

.61 

.72 

.61 

.67 

.79 

.81 

.97 

.88 

.91 

.90 

.87 





17 

Mech. Maintenance (MM) 

.74 

.66 

.46 

.86 

.84 

.74 

.44 

.85 

.61 

.65 

.81 

.95 

.95 

.94 

.97 

.77 




18 

Operators & Food (OF) 

.86 

.79 

.49 

.73 

.80 

.79 

.57 

.86 

.69 

.72 

.92 

.99 

.99 

.99 

1.0 

.89 

.97 



19 

Surveillance & Comm. (SC) 

.92 

.82 

.50 

.60 

.78 

.77 

.69 

.81 

.73 

.74 

.97 

.99 

.99 

.99 

.98 

.92 

.92 

.98 


20 

Skilled Technical (ST) 

.94 

.82 

.50 

.59 

.74 

.80 

.67 

.82 

.75 

.77 

.97 

.99 

.99 

.99 

.97 

.94 

.91 

.98 

1.0 


Note. Results are limited to the Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data, n = 527,925-553,697. All 
correlations are statistically significant,/) < .01 (two-tailed). 
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Table A.12. Correlations among AFQT, ASVAB Subtests, and AA Composite Scores by Education Tier 


Composite/Subtest 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 

1 

AFQT 

ASVAB Subtests 


.76 

.38 

.29 

.52 

.67 

.64 

.57 

.74 

.76 

.95 

.83 

.85 

.84 

.79 

.94 

.66 

.81 

.89 

.91 

2 

Arithmetic Reasoning (AR) 

.82 


.40 

.24 

.36 

.42 

.60 

.49 

.44 

.35 

.87 

.71 

.73 

.75 

.70 

.85 

.57 

.72 

.76 

.77 

3 

Assembling Objects (AO) 

.44 

.46 


.23 

.31 

.29 

.30 

.47 

.28 

.22 

.44 

.46 

.45 

.47 

.44 

.39 

.41 

.45 

.46 

.46 

4 

Auto & Shop Info (AS) 

.38 

.31 

.27 


.65 

.45 

-.02 

.59 

.27 

.33 

.38 

.68 

.67 

.65 

.74 

.34 

.87 

.73 

.59 

.57 

5 

Electronics Information (El) 

.59 

.47 

.35 

.67 


.63 

.17 

.63 

.44 

.53 

.57 

.76 

.79 

.74 

.80 

.54 

.81 

.78 

.76 

.71 

6 

General Science (GS) 

.73 

.53 

.35 

.50 

.67 


.30 

.60 

.55 

.67 

.66 

.76 

.75 

.74 

.76 

.66 

.68 

.74 

.73 

.76 

7 

Math Knowledge (MK) 

.71 

.68 

.38 

.07 

.29 

.42 


.28 

.29 

.19 

.70 

.56 

.53 

.58 

.49 

.51 

.32 

.47 

.61 

.58 

8 

Mech Comprehension (MC) 

.65 

.59 

.51 

.62 

.68 

.66 

.41 


.45 

.47 

.66 

.83 

.80 

.83 

.82 

.59 

.82 

.83 

.78 

.79 

9 

Para Comprehension (PC) 

.79 

.54 

.34 

.35 

.52 

.64 

.41 

.54 


.61 

.68 

.61 

.65 

.61 

.59 

.75 

.52 

.61 

.66 

.69 

10 

Word Knowledge (WK) 
Aptitude Area (AA) Composites 

.80 

.47 

.28 

.42 

.59 

.72 

.33 

.55 

.69 


.67 

.63 

.68 

.63 

.62 

.76 

.56 

.64 

.68 

.72 

11 

Clerical (CL) 

.96 

.90 

.49 

.44 

.64 

.73 

.77 

.72 

.74 

.73 


.91 

.92 

.93 

.88 

.96 

.75 

.89 

.95 

.96 

12 

Combat (CO) 

.88 

.79 

.50 

.68 

.78 

.80 

.67 

.85 

.69 

.71 

.94 


.99 

1.0 

.99 

.83 

.94 

.99 

.99 

.98 

13 

Electronics (EL) 

.90 

.80 

.49 

.67 

.80 

.80 

.64 

.83 

.73 

.75 

.95 

1.0 


.99 

.99 

.87 

.94 

.99 

.99 

.99 

14 

Field Artillery (FA) 

.89 

.81 

.51 

.65 

.76 

.79 

.68 

.85 

.70 

.71 

.95 

1.0 

.99 


.99 

.85 

.93 

.99 

.99 

.99 

15 

General Maintenance (GM) 

.85 

.78 

.49 

.73 

.82 

.80 

.60 

.85 

.67 

.70 

.91 

.99 

.99 

.99 


.81 

.97 

1.0 

.97 

.96 

16 

General Technical (GT) 

.96 

.88 

.45 

.42 

.61 

.73 

.62 

.67 

.79 

.81 

.97 

.88 

.91 

.90 

.87 


.69 

.84 

.89 

.92 

17 

Mech. Maintenance (MM) 

.75 

.67 

.46 

.86 

.84 

.74 

.45 

.85 

.62 

.65 

.81 

.95 

.95 

.94 

.97 

.78 


.97 

.90 

.89 

18 

Operators & Food (OF) 

.87 

.79 

.50 

.73 

.80 

.79 

.58 

.86 

.70 

.72 

.92 

.99 

.99 

.99 

1.0 

.89 

.97 


.97 

.97 

19 

Surveillance & Comm. (SC) 

.92 

.82 

.50 

.60 

.78 

.78 

.70 

.81 

.73 

.74 

.97 

.99 

1.0 

.99 

.98 

.92 

.92 

.98 


.99 

20 

Skilled Technical (ST) 

.94 

.83 

.50 

.59 

.75 

.80 

.68 

.82 

.76 

.77 

.97 

.99 

.99 

.99 

.97 

.95 

.91 

.98 

1.0 



Note. Results are limited to the Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) with valid TAP AS score data. Correlations below the 
diagonal are for Education Tier 1 applicants, n = 498,585-523,190. Correlations above the diagonal are for Education Tier 2 applicants, n = 29,340-30,469. All correlations are 
statistically significant, p < .01 (two-tailed). 



Table A.13. Correlations among AFQT, ASVAB Subtests, AA Composite Scores with TAPAS 
Composites and TAPAS Scales in the TOPS Applicant Sample 


ASVAB Subtests 



AFQT 

AR 

AO 

AS 

El 

GS 

MK 

MC 

PC 

WK 

Individual TAPAS Scales 

Achievement 

.06 

.07 

.02 

.09 

.05 

.01 

.02 

.04 

.06 

.03 

Adjustment 

.12 

.10 

.06 

.14 

.14 

.14 

.03 

.14 

.12 

.12 

Adventure Seeking 

.10 

.10 

.10 

.20 

.16 

.14 

.03 

.20 

.08 

.09 

Attention Seeking 

.05 

.05 

.00 

-.02 

.00 

.01 

.03 

.01 

.05 

.02 

Commitment to Serve 

-.14 

-.11 

-.07 

.00 

-.06 

-.11 

-.12 

-.08 

-.10 

-.12 

Cooperation 

-.07 

-.05 

-.04 

-.09 

-.07 

-.08 

-.02 

-.09 

-.06 

-.07 

Courage 

.07 

.06 

.02 

.14 

.11 

.09 

-.02 

.10 

.09 

.09 

Dominance 

.11 

.10 

.02 

.05 

.05 

.05 

.06 

.06 

.11 

.07 

Even Tempered 

.08 

.06 

.04 

.05 

.08 

.07 

.02 

.06 

.09 

.09 

Intellectual Efficiency 

.33 

.30 

.16 

.13 

.21 

.25 

.23 

.22 

.27 

.26 

Non-Delinquency 

-.04 

-.04 

-.04 

-.03 

-.04 

-.05 

-.02 

-.06 

-.02 

-.03 

Optimism 

.07 

.06 

.01 

.04 

.04 

.05 

.03 

.04 

.08 

.05 

Order 

-.16 

-.10 

-.07 

-.10 

-.13 

-.18 

-.07 

-.15 

-.16 

-.17 

Physical Conditioning 

.05 

.07 

.02 

.03 

.01 

.03 

.07 

.05 

.03 

.01 

Responsibility 

.15 

.10 

.04 

.11 

.10 

.10 

.05 

.09 

.16 

.14 

Self-Control 

-.02 

-.01 

-.01 

-.02 

-.01 

-.04 

-.03 

-.03 

-.01 

-.02 

Selflessness 

-.07 

-.07 

-.06 

-.14 

-.11 

-.10 

-.02 

-.13 

-.05 

-.07 

Situational Awareness 

.02 

.03 

.03 

.11 

.08 

.02 

-.04 

.06 

.03 

.03 

Sociability 

-.11 

-.08 

-.09 

-.07 

-.10 

-.10 

-.07 

-.11 

-.09 

-.10 

Team Orientation 

-.10 

-.06 

-.04 

-.03 

-.06 

-.09 

-.06 

-.07 

-.08 

-.10 

Tolerance 

.04 

-.01 

-.01 

-.11 

-.02 

.02 

.01 

-.05 

.06 

.08 

TAPAS Composites 

Can-Do 

.40 

.35 

.21 

.23 

.30 

.33 

.26 

.32 

.34 

.33 

Will-Do 

.10 

.12 

.02 

.08 

.05 

.05 

.08 

.07 

.09 

.05 

Adaptation 

.17 

.15 

.09 

.11 

.12 

.16 

.11 

.16 

.15 

.14 


Note . Results are limited to the Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) with 
valid TAPAS score data, n = 100,278-553,659. AR = Arithmetic Reasoning, AO = Assembling Objects, AS = Auto & Shop Info, 
El = Electronics Information, GS = General Science, MK = Math Knowledge, MC = Mechanical Comprehension, PC = 


Paragraph Comprehension, WK = Word Knowledge, CL = Clerical, CO = Combat, EL = Electronics, FA = Field Artillery, GM = 
General Maintenance, GT = General Technical, MM = Mechanical Maintenance, OF = Operators & Food, SC = Surveillance and 
Communications, ST = Skilled Technical. Correlations in bold are statistically significant, p < .01 (two-tailed). 
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Table A. 13. (Continued) 


Aptitude Area ( AA ) Composites 



CL 

CO 

EL 

FA 

GM 

GT 

MM 

OF 

SC 

ST 

Individual TAP AS Scales 

Achievement 

.06 

.07 

.07 

.07 

.07 

.07 

.08 

.07 

.07 

.06 

Adjustment 

.12 

.14 

.15 

.14 

.15 

.13 

.16 

.15 

.14 

.14 

Adventure Seeking 

.12 

.17 

.17 

.17 

.18 

.11 

.20 

.18 

.15 

.15 

Attention Seeking 

.04 

.02 

.02 

.02 

.02 

.05 

.01 

.02 

.03 

.03 

Commitment to Serve 

-.13 

-.11 

-.11 

-.11 

-.10 

-.13 

-.08 

-.10 

-.12 

-.12 

Cooperation 

-.07 

-.09 

-.09 

-.08 

-.09 

-.07 

-.09 

-.09 

-.08 

-.08 

Courage 

.07 

.10 

.11 

.10 

.11 

.09 

.13 

.11 

.09 

.10 

Dominance 

.10 

.09 

.09 

.09 

.09 

.11 

.08 

.09 

.09 

.10 

Even Tempered 

.08 

.08 

.08 

.08 

.08 

.09 

.08 

.08 

.08 

.08 

Intellectual Efficiency 

.33 

.30 

.31 

.31 

.30 

.33 

.26 

.30 

.32 

.32 

Non-Delinquency 

-.04 

-.05 

-.05 

-.05 

-.05 

-.04 

-.05 

-.05 

-.05 

-.05 

Optimism 

.07 

.06 

.06 

.06 

.06 

.07 

.06 

.06 

.06 

.06 

Order 

-.15 

-.17 

-.17 

-.16 

-.16 

-.16 

-.15 

-.17 

-.16 

-.17 

Physical Conditioning 

.06 

.06 

.05 

.06 

.06 

.05 

.05 

.06 

.06 

.06 

Responsibility 

.13 

.13 

.14 

.13 

.13 

.15 

.13 

.13 

.13 

.14 

Self-Control 

-.02 

-.03 

-.03 

-.03 

-.03 

-.02 

-.03 

-.03 

-.03 

-.03 

Selflessness 

-.08 

-.12 

-.11 

-.11 

-.12 

-.08 

-.14 

-.12 

-.10 

-.10 

Situational Awareness 

.03 

.05 

.06 

.05 

.06 

.03 

.09 

.07 

.05 

.04 

Sociability 

-.11 

-.12 

-.12 

-.12 

-.12 

-.11 

-.11 

-.12 

-.12 

-.12 

Team Orientation 

-.09 

-.09 

-.09 

-.09 

-.08 

-.09 

-.07 

-.08 

-.09 

-.09 

Tolerance 

.02 

-.03 

-.02 

-.03 

-.03 

.04 

-.06 

-.03 

-.01 

.00 

TAPAS Composites 

Can-Do 

.40 

.40 

.40 

.40 

.39 

.40 

.36 

.40 

.40 

.41 

Will-Do 

.11 

.10 

.10 

.10 

.10 

.11 

.10 

.11 

.10 

.10 

Adaptation 

.18 

.18 

.18 

.18 

.18 

.17 

.17 

.18 

.18 

.18 


Note. Results are limited to the Applicant Sample (non-prior service, Education Tier 1 and 2, AFQT Category IV and above) 
with valid TAP AS score data, n = 100,278-553,659. AR = Arithmetic Reasoning, AO = Assembling Objects, AS = Auto & 
Shop Info, El = Electronics Information, GS = General Science, MK = Math Knowledge, MC = Mechanical Comprehension, 
PC = Paragraph Comprehension, WK = Word Knowledge, CL = Clerical, CO = Combat, EL = Electronics, FA = Field 
Artillery, GM = General Maintenance, GT = General Technical, MM = Mechanical Maintenance, OF = Operators & Food, 
SC = Surveillance and Communications, ST = Skilled Technical. Correlations in bold are statistically significant, p < .01 
(two-tailed). 
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Table A.14. Group Differences on the AFQT and TAPAS by Gender 



Male 



Female 


Measure 

M 

SD 

M 

SD 

d 

AFQT 

55.64 

22.78 

49.36 

21.49 

-.28 

Individual TAPAS Scales 

Achievement 

-.02 

.99 

.06 

.96 

.08 

Adjustment 

.04 

.97 

-.27 

.99 

-.32 

Adventure Seeking 

.01 

.98 

-.28 

.96 

-.30 

Attention Seeking 

-.01 

.98 

-.10 

.98 

-.09 

Commitment to Serve 

-.02 

.99 

.02 

.96 

.04 

Cooperation 

-.01 

.98 

.11 

.98 

.12 

Courage 

.04 

.98 

-.20 

.99 

-.25 

Dominance 

-.01 

.99 

-.03 

.95 

-.02 

Even Tempered 

.02 

.98 

.00 

.99 

-.02 

Intellectual Efficiency 

.02 

.98 

-.09 

.95 

-.10 

Non-Delinquency 

-.01 

.99 

.17 

.95 

.18 

Optimism 

-.01 

.98 

.03 

.98 

.05 

Order 

-.05 

.97 

.18 

1.01 

.23 

Physical Conditioning 

.08 

.98 

-.27 

.97 

-.36 

Responsibility 

-.02 

.99 

.09 

.97 

.11 

Self-Control 

-.01 

.98 

.04 

.98 

.06 

Selflessness 

-.07 

.98 

.38 

.96 

.46 

Situational Awareness 

.02 

.98 

-.20 

.98 

-.23 

Sociability 

-.01 

.99 

.07 

1.00 

.08 

Team Orientation 

.04 

.99 

-.11 

.99 

-.15 

Tolerance 

-.05 

.98 

.26 

.96 

.31 

TAPAS Composites 

Can-Do 

101.15 

20.52 

95.34 

19.79 

-.29 

Will-Do 

100.72 

19.55 

97.11 

18.62 

-.19 

Adaptation 

101.89 

19.30 

93.86 

19.69 

-.41 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, and AFQT > 
10) with valid TAPAS score data. Females are the referent group. Sample sizes for Females range from 21,358 to 
116,425; for Males 75,146 to 418,053. Significant Cohen's d values, based on an independent sample f-test between 
the group means, are in bold (p < .05, two-tailed). 
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Table A.15. Group Differences on the AFQT and TAPAS by Race and Ethnicity 



White, Non-Hispanic 

Black 


Hispanic 


Asian 


Measure 

M 

SD 

M 

SD 

d 

M 

SD 

d 

M 

SD 

d 

AFQT 

59.87 

22.08 

43.40 

18.95 

-.78 

46.91 

20.50 

-.60 

58.05 

23.99 

-.08 

Individual TAPAS Scales 

Achievement 

.04 

1.00 

-.03 

.96 

-.08 

-.06 

.97 

-.11 

-.22 

.98 

-.26 

Adjustment 

.05 

.99 

-.11 

.95 

-.17 

-.12 

.96 

-.18 

-.24 

.96 

-.30 

Adventure Seeking 

.15 

.97 

-.49 

.91 

-.67 

-.05 

.91 

-.21 

-.17 

.92 

-.33 

Attention Seeking 

-.06 

1.00 

.07 

.96 

.13 

-.03 

.95 

.03 

-.05 

.96 

.01 

Commitment to Serve 

.01 

.99 

-.01 

.97 

-.03 

.01 

.98 

.00 

-.10 

1.00 

-.12 

Cooperation 

-.03 

.98 

.13 

.98 

.16 

.01 

.97 

.03 

.12 

.97 

.15 

Courage 

.10 

.98 

-.17 

.98 

-.28 

-.05 

.97 

-.16 

-.31 

1.00 

-.42 

Dominance 

.00 

1.02 

.03 

.90 

.04 

-.05 

.94 

-.05 

-.27 

.94 

-.26 

Even Tempered 

.04 

1.00 

.02 

.97 

-.02 

-.03 

.96 

-.07 

-.08 

.94 

-.12 

Intellectual Efficiency 

.02 

1.00 

.01 

.92 

-.02 

-.08 

.94 

-.11 

-.16 

.96 

-.18 

Non-Delinquency 

.03 

1.00 

.09 

.97 

.06 

.00 

.96 

-.03 

-.07 

.94 

-.11 

Optimism 

.02 

.99 

.02 

.97 

.00 

-.02 

.97 

-.04 

-.16 

.97 

-.18 

Order 

-.12 

.98 

.19 

.96 

.31 

.09 

.94 

.21 

.18 

.93 

.30 

Physical Conditioning 

.06 

1.01 

-.12 

.95 

-.18 

-.02 

.97 

-.08 

-.09 

.95 

-.15 

Responsibility 

.10 

.98 

-.03 

.97 

-.13 

-.16 

.99 

-.27 

-.27 

1.00 

-.37 

Self-Control 

-.07 

.98 

.17 

.96 

.24 

.05 

.97 

.12 

.02 

.96 

.09 

Selflessness 

-.03 

1.00 

.19 

.98 

.22 

.02 

.96 

.06 

.11 

.94 

.14 

Situational Awareness 

-.02 

1.00 

-.01 

.97 

.01 

-.06 

.96 

-.04 

-.10 

.99 

-.09 

Sociability 

.01 

1.02 

.07 

.96 

.06 

.02 

.96 

.01 

-.07 

.98 

-.07 

Team Orientation 

-.02 

1.00 

.01 

.99 

.04 

.07 

.99 

.09 

.20 

1.00 

.22 

Tolerance 

-.09 

1.01 

.13 

.94 

.23 

.17 

.93 

.26 

.28 

.91 

.37 

TAPAS Composites 

Can-Do 

102.21 

20.97 

97.23 

18.92 

-.24 

96.43 

19.40 

-.28 

94.12 

19.63 

-.39 

Will-Do 

101.21 

19.94 

98.50 

18.18 

-.14 

98.82 

18.78 

-.12 

95.01 

18.91 

-.31 

Adaptation 

102.19 

19.77 

96.40 

19.14 

-.30 

98.60 

19.17 

-.18 

97.04 

19.07 

-.26 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, and AFQT > 10) with valid TAPAS score data. The Minority 
group is the referent group. Sample sizes for White, Non-Hispanic applicants range from 54,248 to 302,512; Black applicantss from 24,221 to 121,628; Hispanic 
applicants from 15,528 to 85,345; Asian applicants from 3,891 to 21,237. Significant Cohen's d values, based on an independent sample t -test between the group 
means, are in bold (p < .05, two-tailed). 



Table A.16. Group Differences on the AFQT and TAPAS by Tier 



Tier 1 


Tier 2 



Measure 

M 

SD 

M 

SD 

d 

AFQT 

54.08 

22.71 

52.14 

18.77 

.09 

Individual TAPAS Scales 

Achievement 

-.01 

.98 

.09 

.98 

-.10 

Adjustment 

-.03 

.98 

.12 

.96 

-.16 

Adventure Seeking 

-.06 

.98 

.00 

.98 

-.06 

Attention Seeking 

-.03 

.98 

.00 

1.00 

-.03 

Commitment to Serve 

-.01 

.99 

.20 

.93 

-.22 

Cooperation 

.02 

.98 

-.01 

.98 

.03 

Courage 

-.02 

.99 

.17 

.97 

-.19 

Dominance 

-.01 

.98 

-.06 

.99 

.05 

Even Tempered 

.01 

.98 

.17 

.99 

-.17 

Intellectual Efficiency 

-.01 

.97 

.12 

.94 

-.14 

Non-Delinquency 

.04 

.98 

-.04 

1.02 

.08 

Optimism 

.00 

.98 

.00 

.99 

.00 

Order 

.00 

.98 

-.02 

.97 

.02 

Physical Conditioning 

.01 

.99 

-.16 

.95 

.18 

Responsibility 

.00 

.99 

.09 

1.00 

-.09 

Self-Control 

-.01 

.98 

.12 

.98 

-.13 

Selflessness 

.04 

.99 

-.01 

1.00 

.04 

Situational Awareness 

-.04 

.98 

.15 

.99 

-.19 

Sociability 

.02 

.99 

.04 

1.01 

-.02 

Team Orientation 

.01 

1.00 

.04 

1.04 

-.03 

Tolerance 

.01 

.98 

.09 

.98 

-.07 

TAPAS Composites 

Can-Do 

99.68 

20.48 

102.29 

19.80 

-.13 

Will-Do 

100.00 

19.41 

98.41 

18.96 

.08 

Adaptation 

100.13 

19.69 

98.81 

18.92 

.07 


Note. Results are limited to the TOPS Applicant Sample (non-prior service, Education Tier 1 and 2, and AFQT > 

10) with valid TAPAS score data. Tier 2 is the referent group. Sample sizes for Tier 1 Soldiers range from 94,347 to 
523,222; for Tier 2 Soldiers 5,935 to 30,475. Significant Cohen's d values, based on an independent sample r-test 
between the group means, are in bold (p < .05, two-tailed). 
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APPENDIX B 


CORRELATIONS AMONG CRITERION MEASURES IN THE IMT AND IN-UNIT 

VALIDATION SAMPLES 

Table B.l. Correlations among the Performance Rating Scales (PRS) in the IMT Validation 
Sample 


Domain/PRS 

1 

2 

3 

4 

5 

6 


Army-Wide 







1. 

Adjustment to the Army 







2. 

Effort & Personal Discipline 

.73 






3. 

MOS Qualification Knowledge 

.71 

.66 





4. 

Physical Fitness & Bearing 

.65 

.66 

.58 




5. 

Working with Others 

.72 

.74 

.67 

.62 



6. 

Overall Performance 

.62 

.62 

.60 

.55 

.56 



MOS-Specific 







7. 

11 B/C/X + 18X 

.68 

.65 

.69 

.61 

.67 

.57 

8. 

19K 

.57 

.56 

.72 

.56 

.41 

.72 

9. 

31B 

.68 

.64 

.73 

.54 

.68 

.59 

10. 

42A 

.64 

.63 

.70 

.41 

.65 

.71 

11. 

68W 

.74 

.68 

.74 

.61 

.71 

.46 

12. 

88M 

.67 

.62 

.65 

.62 

.64 

.60 

13. 

All MOS Combined a 

.69 

.65 

.72 

.58 

.66 

.56 


Note. Army-wide PRS: n = 7,049-7,645. MOS-speeific PRS: 11B, n = 1,643-1,646; 19K, n = 382-383; 31B. n = 1,099-1,104; 
42A, n = 358; 68W, n = 718-740; 88M, n = 110-111. All MOS Combined, n = 4,384-4,408. Ratings on PRS range from 1 and 5. 
PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded 
from analyses. Results based on fewer than 100 cases are not reported. All correlations are statistically significant (p < .05, one- 
tailed). 

“Includes 11B/C/X + 18X, 19K, 31B, 42A, 68W, 88M, and 91B. 


Table B.2. Correlations among the Performance Rating Scales (PRS) in the In-Unit 
Validation Sample 


PRS 


1 

2 

3 

4 

5 

6 

1 . 

Can Do a 







2. 

Effort & Personal Discipline a 

.79 






3. 

Physical Fitness & Bearing 

.57 

.59 





4. 

Self-Management a 

.75 

.76 

.59 




5. 

Working with Others a 

.79 

.79 

.55 

.74 



6. 

Adjustment to Army Life 

.72 

.75 

.67 

.72 

.69 


7. 

Overall Leadership Potential 

.69 

.69 

.62 

.69 

.64 

.77 


Note. Army-wide PRS, n = 2,162-2,457. Ratings on PRS range from 1 and 7. PRS ratings from supervisors with a familiarity 
rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. All correlations are statistically 
significant (p < .05, one-tailed). 

“Ratings composite comprises two or more Army-wide PRS. 
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Table B.3. Correlations among the Army Life Questionnaire (ALQ) Scales in the IMT and In-Unit Validation Samples 


Scale 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

1 . 

Affective Commitment 


.78 

.42 

.53 


.62 

.55 

-.56 


-.13 

-.13 

.06 

2. 

Army Fit 

.84 


.45 

.53 


.61 

.57 

-.65 


-.19 

-.16 

.09 

3. 

MOS Fit 

.46 

.47 


.55 


.30 

.24 

-.31 


-.11 

-.09 

.03 

4. 

MOS Satisfaction 






.38 

.31 

-.36 


-.11 

-.09 

.01 

5. 

Normative Commitment 

.69 

.72 

.40 










6. 

Army Career Intentions 

.56 

.52 

.24 


.43 


.82 

-.48 


-.13 

-.13 

.07 

7. 

Army Reenlistment Intentions 

.53 

.53 

.26 


.46 

.85 


-.46 


-.11 

-.11 

.06 

8. 

Attrition Cognition 

-.62 

-.68 

-.40 


-.73 

-.46 

-.49 



.23 

.18 

-.14 

9. 

Army Life Adjustment 

.45 

.61 

.34 


.46 

.36 

.39 

-.52 





10. 

Disciplinary Incidents (#) 

-.07 

-.10 

-.08 


-.07 

-.04 

-.05 

.11 

-.17 


.80 

-.06 

11. 

Disciplinary Incidents (Y/N) 

-.06 

-.09 

-.08 


-.06 

-.05 

-.05 

.09 

-.16 

.86 


-.08 

12. 

APFT Score 

.03 

.09 

.07 


.06 

.03 

.04 

-.10 

.22 

-.13 

-.16 


13. 

Training Achievement (#) 

.05 

.06 

.05 


.00 

.08 

.06 

-.03 

.12 

-.07 

-.09 

.24 

14. 

Training Failures (#) a 

-.03 

-.04 

-.05 


-.03 

-.02 

-.03 

.05 

-.09 

.13 

.12 

-.06 


Note. Correlations below the diagonal reflect the IMT ALQ, n = 23,519-25,884. Correlations above the diagonal reflect the in-unit ALQ, n = 2,932-3,060. Missing values reflect 
the scales that were not administered in either IMT or In-Unit. Correlations in bold are statistically significant, p < .01 (two-tailed). 

a Training Failures (#) is based on the total number of affirmative responses to whether a Soldier restarted from BCT or OSUT or whether a Soldier repeated a block or module at 
AIT or OSUT . 



B-3 


Table B.4. Correlations between the Army Life Questionnaire (ALQ) Scales and Job Knowledge Tests (JKTs) in the IMT and In- 
Unit Validation Samples 

IMT/In-Unit JKTs 


All MOS 


Setting/ Scale 

WTBD 

Combined a 

1 IB 

19K 

31B 

42A 

68W 

88M 

91B 

IMT 

Affective Commitment 

.09 

.09 

.11 

.20 

.05 

.18 

.04 

.05 

.16 

Army Fit 

.15 

.13 

.17 

.22 

.07 

.18 

.10 

.09 

.18 

MOS Fit 

.13 

.10 

.13 

.15 

.05 

-.01 

.16 

-.01 

.30 

Normative Commitment 

.21 

.19 

.22 

.25 

.14 

.19 

.17 

.16 

.19 

Army Career Intentions 

-.02 

.00 

.01 

.04 

.01 

.01 

-.02 

-.02 

.03 

Army Reenlistment 

Intentions 

.03 

.05 

.06 

.09 

.04 

.08 

.03 

.04 

.07 

Attrition Cognitions 

-.18 

-.16 

-.19 

-.20 

-.11 

-.17 

-.15 

-.12 

-.16 

Army Life Adjustment 

.13 

.12 

.12 

.06 

.11 

.15 

.12 

.10 

.14 

Disciplinary Incidents (#) 

-.04 

-.04 

-.02 

-.04 

-.06 

-.04 

-.06 

.01 

-.03 

Disciplinary Incidents (Y/N) 

-.03 

-.02 

-.01 

-.04 

-.05 

-.01 

-.03 

.01 

-.01 

APFT Score 

.07 

.02 

.05 

-.01 

.01 

.02 

.01 

-.02 

-.03 

Training Achievement (#) 

-.10 

-.09 

-.13 

-.15 

-.04 

-.09 

.01 

-.12 

-.12 

Training Failures (#) b 

-.02 

-.04 

-.02 

-.09 

-.09 

-.07 

-.07 

.01 

.01 

In-Unit 

Affective Commitment 

.07 

-.02 

-.02 




.05 

-.08 

.07 

Army Fit 

.11 

.05 

.02 

- 

- 

- 

.13 

.07 

.12 

MOS Fit 

.10 

.07 

.03 

- 

- 

- 

.06 

.09 

.36 

MOS Satisfaction 

-.04 

-.04 

-.05 

- 

- 

- 

.03 

-.09 

.21 

Army Career Intentions 

.01 

-.05 

-.03 

— 

— 

— 

-.01 

-.02 

-.09 

Army Reenlistment 

Intentions 

.04 

-.01 

.02 




-.02 

.04 

-.11 

Attrition Cognitions 

-.14 

-.05 

-.05 

- 

- 

- 

.05 

-.16 

-.16 

Disciplinary Incidents (#) 

-.08 

-.06 

-.03 

- 

- 

- 

-.17 

-.07 

-.10 

Disciplinary Incidents (Y/N) 

-.08 

-.05 

-.05 

- 

- 

- 

-.10 

-.04 

-.04 

APFT Score 

.00 

-.02 

.00 

- 

- 

- 

-.03 

-.07 

-.07 


Note. WTBD = Warrior Tasks and Battle Drills. IMT: All MOS Combined, n = 17,530-18,867; 11B, n = 6,779-6,957; 19K, n = 1,094-1,141; 31B, n = 2,747-3,138; 42A, n = 
1,135-1,162; 68W, n = 2,814-3,323; 88M, n = 2,199-2,531; 91B, n = 511-615; WTBD, n = 22,639-24,264. In-Unit: All MOS Combined, n = 1,147-1,194; 1 IB, n = 603-621; 68W, 
n = 105-114; 88M, n = 133-139; 91B, n = 123-126; WTBD, n = 2,854-2,979. Results with fewer than 100 cases are not reported. Correlations in bold are statistically significant (p 
< .05, two-tailed). a Includes 11B/C/X + 18X, 19K, 3IB, 42A, 68W, 88M, and 9 IB. b Training Failures (#) is based on the total number of affirmative responses to whether a 
Soldier restarted from BCT or OSUT or whether a Soldier repeated a block or module at AIT or OSUT. 
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Table B.5. Correlations between the Army Life Questionnaire (ALQ) Scales and Performance Rating Scales (PRS) in the IMT 
Validation Sample 


Domain/PRS 

AFF 

COM 

Army 

Fit 

MOS 

Fit 

NORM 

COM 

CAR 

INT 

RENL 

INT 

ATT 

COG 

AL 

ADI 

DIS 

INC 

# 

DIS 

INC 

Y/N 

APFT 

TRN 

ACH 

TRN 

FAIL 

Army-Wide 

Adjustment to the Army 

.06 

.07 

.07 

.04 

.03 

.04 

-.07 

.09 

-.14 

-.13 

.16 

.10 

-.01 

Effort & Personal Discipline 

.06 

.09 

.06 

.06 

.03 

.04 

-.08 

.10 

-.14 

-.12 

.16 

.09 

.02 

MOS Qualification Knowledge 

.04 

.06 

.05 

.03 

.02 

.03 

-.05 

.08 

-.11 

-.11 

.13 

.08 

-.01 

Physical Fitness & Bearing 

.04 

.07 

.04 

.04 

.03 

.04 

-.07 

.12 

-.11 

-.12 

.31 

.14 

.00 

Working with Others 

.04 

.06 

.04 

.04 

.03 

.04 

-.05 

.07 

-.10 

-.09 

.12 

.06 

.02 

Overall Performance 

.05 

.08 

.07 

.06 

.03 

.04 

-.09 

.13 

-.17 

-.16 

.22 

.14 

-.04 

MOS-Specific 

All MOS Combined a 

.07 

.09 

.05 

.06 

.05 

.05 

-.08 

.08 

-.08 

-.08 

.10 

.08 

.02 

11B/C/X + 18X 

.04 

.05 

.10 

.05 

.02 

.03 

-.07 

.04 

-.08 

-.11 

.10 

.07 

.01 

19K 

.12 

.10 

.11 

.11 

.10 

.09 

-.11 

.15 

-.15 

-.15 

.17 

.16 

-.04 

31B 

.09 

.12 

.05 

.06 

.05 

.05 

-.10 

.14 

-.15 

-.13 

.06 

.13 

.00 

42A 

.08 

.12 

.08 

.12 

.09 

.11 

-.08 

.18 

-.13 

-.11 

.20 

.13 

-.28 

68W 

.08 

.10 

.03 

.08 

.06 

.06 

-.08 

.08 

-.02 

-.02 

.13 

-.01 

.09 

88M 

.01 

.01 

-.08 

-.05 

-.08 

-.07 

.14 

-.14 

- 

- 

.14 

-.06 

.06 


Note. AFF COM = Affective Commitment; NORM COM = Normative Commitment; CAR INT = Army Career Intentions; RENL INT = Army Reenlistment Intentions; ATT 
COG = Attrition Cognitions; AL ADJ = Army Life Adjustment; DIS INC # = Disciplinary Incidents (#); DIS INC Y/N = Disciplinary Incidents (Y/N); APFT = APFT Score; TRN 
ACH = Training Achievements (#); TRN FAIL = Training Failures (#).Army-wide PRS: n = 6,495-7,452. MOS-specific PRS: All MOS Combined n = 4,233-4,606; 1 IB n = 
1,638-1,681; 19K n = 369-385; 31B /; = 1,018-1,142; 42A n = 352-359; 68W n = 664-856; 88M n = 114-118. Results based on fewer than 100 cases are not reported. Ratings on 
IMT PRS range from 1 and 5. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. 
Correlations in bold are statistically significant (p < .05, two-tailed). 

“Includes 11B/C/X + 18X, 19K, 31B, 42A, 68W, 88M, and 91B. 
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Table B.6. Correlations between the Army Life Questionnaire (ALQ) Scales and Performance Rating Scales (PRS) in the In-Unit 
Validation Sample 


PRS 





In-Unit ALQ Scale 




AFF 

COM 

Army 

Fit 

MOS 

Fit 

MOS 

SAT 

CAR 

INT 

RENL 

INT 

ATT 

COG 

DIS 

INC# 

DIS 

INC Y/N 

APFT 

Can Do a 

.05 

.08 

.07 

.00 

.07 

.08 

-.14 

-.22 

-.19 

.15 

Effort & Personal Discipline a 

.08 

.10 

.07 

.03 

.07 

.08 

-.15 

-.29 

-.24 

.13 

Physical Fitness & Bearing 

.08 

.12 

.05 

.04 

.07 

.07 

-.20 

-.22 

-.21 

.37 

Self-Management a 

.07 

.10 

.06 

.01 

.08 

.09 

-.16 

-.26 

-.21 

.14 

Working with Others a 

.05 

.08 

.05 

-.01 

.05 

.06 

-.12 

-.22 

-.18 

.11 

Adjustment to Army Life 

.15 

.20 

.11 

.09 

.14 

.14 

-.25 

-.33 

-.28 

.19 

Overall Leadership Potential 

.13 

.16 

.09 

.04 

.12 

.12 

-.21 

-.26 

-.22 

.22 


Note. AFFCOM = Affective Commitment; MOS SAT = MOS Satisfaction; CAR INT = Army Career Intentions; RENL INT = Army Reenlistment Intentions; 
ATT COG = Attrition Cognitions; DIS INC = Disciplinary Incidents (#); DIS INC Y/N = Disciplinary Incidents (Y/N); APFT = APFT Score. Ratings on PRS 
range from 1 and 7. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from 
analyses. Army-wide PRS, n = 2,113-2,428. Correlations in bold are statistically significant (p < .05, two-tailed). 
a Ratings composite comprises two or more Army-wide PRS. 
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Table B.7. Correlations between the Job Knowledge Tests (JKTs) and Performance Rating Scales (PRS) in the IMT Validation 
Sample 


Domain/PRS 

All MOS 
Combined a 

11B/C/X 
+ 18X 

19K 

31B 

42A 

68W 

WTBD 

Army-Wide 








Adjustment to the Army 

.05 

.05 

.20 

.02 

.19 

-.03 

.06 

Effort & Personal Discipline 

.09 

.06 

.23 

.04 

.27 

.01 

.07 

MOS Qualification Knowledge 

.07 

.07 

.17 

.03 

.26 

-.02 

.06 

Physical Fitness & Bearing 

.05 

.07 

.10 

.02 

.08 

-.04 

.04 

Working with Others 

.07 

.04 

.17 

.01 

.22 

-.02 

.05 

Overall Performance 

.07 

.10 

.16 

.05 

.22 

.00 

.07 

MOS-Specific 








All MOS Combined a 

.09 

.08 

.16 

-.02 

.20 

-.02 

.09 

11B/C/X + 18X 

.10 

.08 





.14 

19K 

.15 


.16 




.20 

31B 

.05 



-.02 



.05 

42A 

.20 




.20 


.18 

68W 

.04 





-.02 

.04 

88M 

- 






.05 


Note. WTBD = Warrior Tasks and Battle Drills. Army-wide PRS: All MOS Combined, n = 5,379-5,851; 11B, n = 1,630-1,634; 19K, n 
= 391-396; 31B, n = 1,168-1,172; 42A, n = 369; 68W, n = 1,671-2,130; WTBD, n = 6,626-7,186. Ratings on IMT PRS range from 1 
and 5. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded 
from analyses. MOS-specific PRS: All MOS Combined, n = 339-3,983; 11B, n = 1,370; 19K, n = 340; 31B. n = 1,057; 42A, n = 339; 
68W, n = 747; WTBD, n = 101-4,470. Results based on fewer than 100 cases are not reported. Correlations in bold are statistically 
significant (p < .05, two-tailed). 

a Includes 11B/C/X + 18X,19K, 31B, 42A, 68W, 88M. and 91B. 



Table B.8. Correlations between the Job Knowledge Tests (JKTs) and Performance Rating 
Scales (PRS) in the In-Unit Validation Sample 


PRS 




In-Unit JKT 

All MOS 
Combined 3 

11B/C/X+ 18X 

88M 

91B 

WTBD 

Can Do b 

.15 

.12 

.22 

.20 

.13 

Effort & Personal Discipline b 

.15 

.11 

.24 

.27 

.13 

Physical Fitness & Bearing 

.07 

.04 

.16 

.10 

.08 

Self-Management b 

.12 

.09 

.16 

.14 

.10 

Working with Others b 

.13 

.09 

.22 

.27 

.13 

Adjustment to Army Life 

.13 

.10 

.13 

- 

.12 

Overall Leadership Potential 

.12 

.08 

.15 

.17 

.12 


Note. WTBD = Warrior Tasks and Battle Drills. Army-wide PRS: All MOS Combined, n = 868-969; 1 IB, n = 452-511; 88M, n 
= 102-113; 91B, n = 103-104; WTBD, n = 2,150-2,386. Ratings on PRS range from 1 and 7. PRS ratings from supervisors with a 
familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. Results based on 
fewer than 100 cases are not reported. Correlations in bold are statistically significant (p < .05, two-tailed). 

3 Includes 11B/C/X + 18X, 1 9K, 3 1B . 42 A, 68W, 8 8M, and 9 1B . 
b Ratings composite comprises two or more Army-wide PRS. 


Table B.9. Correlations between the Job Knowledge Tests (JKTs) and Administrative Criteria 
in the IMT Validation Sample 


IMT JKT 


Domain/Measure 

All MOS 
Combined 3 

11 B/C/X 
+ 18X 

19K 

31B 

42A 

68W 

88M 

91B 

WTBD 

Attrition b 










6-Month Cumulative 

.01 

.00 

-.03 

.05 





-.01 

12-Month Cumulative 

-.01 

-.01 

-.05 

-.01 

.00 

.02 

-.09 

-.06 

-.03 

24-Month Cumulative 

-.07 

-.08 

-.04 

-.06 

-.03 

-.04 

-.07 

-.09 

-.09 

36-Month Cumulative 

-.07 

-.08 

- 

-.08 


-.04 

-.07 

-.10 

-.08 

Restarted Initial Military Training 










(IMT) 










IMT Restarts 

.00 

-.02 

-.02 

-.03 

-.01 

.05 

-.01 

.02 

.00 

IMT Failures 

.01 

.03 

.04 

.03 

.03 

-.04 

.01 

-.01 

.01 

For Pejorative Reasons 

.02 

.03 

.04 

.03 

.03 

.01 

.02 

-.01 

.02 

For Academic Reasons 

.01 

.03 

.04 

.04 

.03 

-.04 

.01 

-.03 

.00 

Final AIT School Grades 










Overall Average (Unstandardized) 

.11 

— 

— 

— 

— 

— 

— 

— 

.27 

Overall Average (Standardized) 

.20 

— 

— 

— 

— 

— 

— 

— 

.32 


Note. WTBD = Warrior Tasks and Battle Drills. Attrition: All MOS Combined, n = 5,630-11,368; 11B, n = 2,890-5,389; 19K, n 
= 217-873; 31B, n = 868-1,358; 42A, n = 252-550; 68W, n = 1,203-2,108; 88M, n = 437-704; 91B. n = 147-386; WTBD, n = 
6,716-14,698. Tr a ining Restarts: All MOS Combined, n = 14,401-19,099; 11B, n = 5,367-7,045; 19K, n = 681-1,171; 31B. n = 
2,204-3,165; 42A, n = 945-1,178; 68W, n = 2,452-3,361; 88M, n = 2,197-2,554; 91B, n = 530-625; WTBD, n = 18,312-24,592. 
Final AIT School Grade: All MOS Combined, n = 113-114; WTBD, n = 313-315. For Training Restarts, IMT Restarts coded 1 = 
Restarted at Least Once, 0 = No Restarts; IMT Failures variables coded as 1 = No Failure, 0 = Failed at Least Once. Results 
based on fewer than 100 cases are not reported. Correlations in bold are statistically significant (p < .05, two-tailed). Blank cells 
indicate correlations that could not be computed due to no variance in attrition at point in time. 

“ Includes 11 B/C/X + 18X, 19K, 31B. 42A, 68W, 8 8M, and 91B. 
b Attrition results include Regular Army Soldiers only. 
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Table B.10. Correlations between the Army Life Questionnaire (ALQ) and Administrative Criteria in the IMT Validation Sample 

IMT ALQ Scale 


Domain/Measure 

AFF 

COM 

Army 

Fit 

MOS 

Fit 

NORM 

COM 

CAR 

INT 

RENL 

INT 

ATT 

COG 

AL 

ADJ 

DIS 

INC# 

DIS 

INC 

Y/N 

APFT 

TRN 

ACH 

TRN 

FAIL 

Attrition a 

6-Month Cumulative 

-.05 

-.07 

-.06 

-.07 

-.04 

-.03 

.14 

-.09 

.05 

.05 

-.06 

-.02 

.02 

12-Month Cumulative 

-.05 

-.07 

-.05 

-.07 

-.05 

-.05 

.14 

-.08 

.06 

.06 

-.06 

-.02 

.01 

24-Month Cumulative 

-.03 

-.07 

-.05 

-.06 

-.02 

-.04 

.11 

-.09 

.05 

.06 

-.09 

-.01 

.01 

36-Month Cumulative 

-.04 

-.07 

-.07 

-.07 

-.03 

-.05 

.10 

-.11 

.07 

.07 

-.11 

-.04 

.02 

Restarted Initial Military Training 
(IMT) 

IMT Restarts 

-.01 

-.01 

-.02 

.00 

.00 

.00 

.02 

-.02 

.06 

.05 

-.03 

.02 

.33 

IMT Failures 

.02 

.03 

.04 

.03 

.01 

.01 

-.06 

.05 

-.09 

-.08 

.05 

-.01 

-.35 

For Pejorative Reasons 

.02 

.04 

.06 

.04 

.01 

.01 

-.07 

.06 

-.10 

-.09 

.06 

.03 

-.38 

For Academic Reasons 

.01 

.02 

.03 

.01 

.00 

.00 

-.04 

.03 

-.08 

-.07 

.04 

-.01 

-.36 

Final AIT School Grades 

Overall Average (Unstandardized) 

-.05 

-.01 

.18 

.01 

-.07 

-.08 

.04 

-.05 

.03 

.04 

-.11 

.02 

-.05 

Overall Average (Standardized) 

-.09 

-.04 

.15 

-.01 

-.12 

-.08 

.03 

-.01 

.00 

.02 

-.14 

-.09 

.01 


Note. AFF COM = Affective Commitment; NORM COM = Normative Commitment; CAR INT = Army Career Intentions; RENL INT = Army Reenlistment Intentions; ATT 
COG = Attrition Cognitions; AL ADJ = Army Life Adjustment; DIS INC # = Disciplinary Incidents (#); DIS INC Y/N = Disciplinary Incidents (Y/N); APFT = APFT Score; TRN 
ACH = Training Achievements (# of); TRN FAIL= Training Failure (# of). Attrition: n = 6,371-15,452. Training Restarts: n = 18,021-25,865. Final AIT School Grade: n = 152- 
331. Correlations in bold are statistically significant (p < .05, two-tailed). 
a Attrition results include Regular Army Soldiers only. 



Table B.ll. Correlations between the Performance Rating Scales (PRS) and Attrition in the 
IMT Validation Sample 


Attrition a 

Domain/PRS 

6- Month 

12-Month 

24-Month 

36-Month 

Army-Wide 





Adjustment to the Army 

-.05 

-.05 

-.05 

-.04 

Effort & Discipline 

-.05 

-.05 

-.05 

-.04 

MOS Qualification Knowledge & Skill 

-.05 

-.03 

-.05 

-.03 

Physical Fitness & Bearing 

-.07 

-.07 

-.07 

-.07 

Working with Others 

-.03 

-.04 

-.04 

-.05 

Overall Performance 

-.06 

-.08 

-.08 

-.09 

MOS-Specific 





All MOS Combined b 

.00 

-.02 

-.04 

-.04 

11 B/C/X and 18X 

.04 

-.01 

-.03 

-.07 

19K 


-.06 

— 

— 

31B 

-.08 

-.07 

-.13 

-.10 

42A 



— 

— 

68W 


.03 

-.01 

.06 


Note. Sample is limited to Army-wide PRS: N= 1,838-4,879. MOS-specific PRS: All MOS Combined, n = 1,284-2,914; 11B, n 
= 922-1,340; 19K, n = 328; 31B, n = 343-488; 42A, n = 181; 68W, n = 422-538. Ratings on IMT PRS range from 1 and 5. PRS 
ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from 
analyses. Results based on fewer than 100 cases are not reported. Correlations in bold are statistically significant (p < .05, two- 
tailed). Blank cells indicate correlations that could not be computed due to no variance in attrition at point in time. 
a Attrition results include Regular Army Soldiers only. 
b Includes 11B/C/X + 18X, 19K, 3IB, 42A, 68W, 88M, and 9IB. 

Table B.12. Correlations between the Performance Rating Scales (PRS) and Administrative 
Criteria in the IMT Validation Sample 


Training Restarts 


Domain/PRS 

IMT 

Restarts 

IMT 

Failures 

PEJ 

Failures 

ACAD 

Failures 

Army-Wide 

Adjustment to the Army 

-.02 

.04 

.04 

.03 

Effort & Discipline 

.00 

.01 

.02 

.00 

MOS Qualification Knowledge & Skill 

.00 

.02 

.02 

.01 

Physical Fitness & Bearing 

.01 

.03 

.03 

.01 

Working with Others 

.00 

.01 

.02 

.00 

Overall Performance 

-.01 

.05 

.06 

.03 

MOS-Specific 

All MOS Combined a 

.00 

.00 

.01 

.00 

11B/C/X + 18X 

.01 

-.01 

-.01 

-.01 

19K 

-.07 

.07 

.07 

.07 

31B 

-.01 

.02 

.03 

.00 

42A 

-.10 

.24 

.22 

.23 

68W 

.04 

-.03 

-.01 

-.03 

88M 

.29 

-.27 

-.02 

-.27 


Note. IMT Restarts = Restarted at Least Once During IMT; IMT Failures = Failed at Least Once During IMT; PEJ Failures = Failed at 
Least Once for Academic or Other Pejorative Reason; ACAD Failures =Failed at Least Once for Academic Reasons. Army-wide PRS, n 
= 5,380-7,640. MOS-specific PRS: All MOS Combined, n = 3,725-4,738; 1 IB. n = 1,545-1,750; 19K, n = 283-399; 31B, n = 798-1,158; 
42A, n = 261-362; 68W, n = 650-879; 88M, n = 117-122. Ratings on IMT PRS range from 1 and 5. PRS ratings from supervisors with a 
familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. Results based on fewer than 
100 cases are not reported. Correlations in bold are statistically significant (p < .05, two-tailed). 
a Includes 11B/C/X + 18X, 19K, 31B, 42A, 68W, 8 8M, and 91B. 
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Table B.13. Correlations among the Criterion Composites in the IMT and In-Unit (IU) 
Validation Samples 




1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

n 

1 

IMT: Overall Performance 












2 

IMT: Physical Fitness 

.21 











3 

IMT: Commitment & Fit 

.08 

.07 










4 

IMT: Retention Cognitions 

.02 

.00 

.36 









5 

IMT: Knowledge & Skill 

.10 

.05 

.17 

-.04 








6 

IU: Overall Performance 

.19 

.16 

-.05 

-.11 

.00 







7 

IU: Physical Fitness 

.13 

.61 

.07 

-.05 

-.01 

.22 






8 

IU: Commitment & Fit 

.05 

-.03 

.38 

.21 

.01 

.12 

.07 





9 

IU: Retention Cognitions 

.10 

.03 

.17 

.46 

-.05 

.04 

.02 

.44 




10 

IU: Knowledge & Skill 

.04 

.00 

.15 

-.02 

.49 

.15 

.00 

.10 

-.03 



11 

Can Do Performance 

.10 

.05 

.19 

-.04 

1 . 00 a 

.04 

-.02 

.00 

-.08 

.48 


12 

Will Do Performance 

.50 

.61 

.40 

.25 

.09 

— 

— 

— 

— 

— 

.10 


Note, n = 104-25,884. Results based on fewer than 100 cases are not reported. Correlations in bold are statistically significant (p 
< .05, two-tailed). 

a 99% of the Soldiers' scores on these two composites are based on the same subscores, resulting in a very high correlation 
it-.998). 
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Table B.14. Group Differences on IMT and In-Unit Technical Performance, Motivation- 
Based Performance, and Attrition by Education Tier 




Tier 1 


Tier 2 


Measure 

M 

SD 

M 

SD 

d 

IMT 

Knowledge & Skill 

.03 

.86 

.08 

.86 

-.06 

WTBD JKT 

.64 

.12 

.64 

.12 

-.05 

Can Do Performance 

-.05 

1.61 

.04 

1.59 

-.06 

Army Fit 

4.09 

.59 

4.16 

.60 

-.12 

Army Life Adjustment 

4.09 

.66 

4.13 

.65 

-.06 

Commitment & Fit 

3.98 

.58 

4.06 

.57 

-.15 

Retention Cognitions 

2.73 

.58 

2.84 

.57 

-.18 

APFT 

253.27 

28.08 

246.65 

28.04 

.24 

Will Do Performance 

.25 

3.05 

-.40 

3.07 

.21 

PRS: Effort and Discipline 

3.30 

.96 

3.15 

.98 

.15 

PRS: Adjustment to the Army 

3.46 

.97 

3.29 

.98 

.17 

PRS: Physical Fitness & Bearing 

3.34 

.96 

3.15 

.96 

.20 

PRS: Working with Others 

3.31 

.96 

3.24 

.99 

.07 

PRS: Overall Performance 

3.39 

.78 

3.25 

.75 

.17 

IMT Restarts 

.05 

.21 

.05 

.23 

-.02 

Disciplinary Incidents (Y/N) 

.22 

.41 

.25 

.43 

-.06 

Attrition 

6-Month 

.08 

.27 

.11 

.31 

-.11 

12-Month 

.09 

.29 

.11 

.31 

-.06 

24-Month 

.11 

.31 

.14 

.34 

-.09 

36-Month 

.11 

.31 

.11 

.32 

-.01 


Note. Tier 2 is the referent group. Sample size for Tier 1 Soldiers range from 2,314 to 295,585; for Tier 2 Soldiers 
139 to 12,361.Sample sizes of less than 100 are not reported, which includes all In-Unit criteria. Significant Cohen's 
d values, based on an independent sample f-test between the group means, are in bold (p < .05, two-tailed). 
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APPENDIX C 


CRITERION PSYCHOMETRIC PROPERTIES IN THE FULL IMT AND IN-UNIT 

SAMPLES 


Table C.l. Descriptive Statistics for the Job Knowledge Tests (JKTs) in the Full IMT and In- 
Unit Samples 


Domain/Setting/JKT 

n 

M 

SD 

Min 

Max 

fWTBD 

IMT 

MOS-Specific 







11B/C/X + 18X 

16,564 

60.87 

10.27 

20.93 

88.37 

.56 

19K 

1,626 

62.65 

11.51 

21.54 

92.31 

.57 

31B 

7,694 

67.79 

8.78 

33.33 

93.20 

.50 

42A 

1,621 

54.51 

12.48 

16.67 

85.19 

.53 

68W 

9,671 

73.13 

10.25 

25.00 

96.74 

.50 

88M 

6,313 

63.58 

10.48 

30.56 

94.44 

.55 

91B 

1,665 

58.06 

12.75 

23.71 

90.72 

.45 

All MOS Combined a 

45,154 

64.79 

11.57 

16.67 

96.74 

.51 

WTBD (Army-Wide) 

57,421 

64.26 

12.45 

6.45 

100.00 


In-Unit 

MOS-Specific 







11B/C/X + 18X 

1,361 

62.42 

8.71 

24.74 

84.51 

.54 

19K 

144 

76.90 

10.38 

37.25 

92.59 

.47 

31B 

141 

63.18 

10.99 

29.57 

85.22 

.60 

42A 

101 

53.24 

7.36 

35.29 

75.29 

.37 

68W 

327 

71.94 

7.36 

36.79 

90.57 

.49 

88M 

328 

63.81 

9.40 

35.64 

87.23 

.52 

91B 

303 

63.13 

11.14 

35.09 

85.26 

.31 

All MOS Combined a 

2,705 

64.29 

10.26 

24.74 

92.59 

.46 

WTBD (Army-Wide) 

7,096 

64.30 

11.54 

15.38 

100.00 



Note. M, SD, Min. and Max are based on percent correct. WTBD = Warrior Tasks and Battle Drills, hvtbd = correlation with 
WTBD JKT scores. All correlations are statistically significant (p < .05, one-tailed). 
a Includes 11B/C/X + 18X, 19K, 31B.42A, 68W, 88M, and91B. 


C-l 




Table C.2. Descriptive Statistics Estimates for the Performance Rating Scales (PRS) in the 
Full IMT and In-Unit Samples 


Domain/Setting/PRS 

n 

M 

SD 

Min 

Max 

IMT 

Army-Wide 






Adjustment to the Army 

19.469 

3.30 

1.01 

1.00 

5.00 

Effort & Personal Discipline 

19.495 

3.12 

0.99 

1.00 

5.00 

MOS Qualification Knowledge 

17,609 

3.26 

0.96 

1.00 

5.00 

Physical Fitness & Bearing 

19,398 

3.17 

1.00 

1.00 

5.00 

Working with Others 

19,410 

3.11 

0.99 

1.00 

5.00 

Overall Performance 

19,209 

3.52 

0.85 

1.00 

5.00 

MOS-Specific 






11B/C/X+ 18X 

5,259 

3.02 

0.82 

1.00 

5.00 

19K 

595 

3.34 

0.69 

1.00 

5.00 

31B 

2,731 

3.22 

0.78 

1.00 

5.00 

42A 

496 

3.71 

0.68 

1.80 

5.00 

68W 

3,611 

2.77 

0.80 

1.00 

5.00 

88M 

671 

2.87 

0.76 

1.20 

5.00 

91B 

286 

2.98 

1.13 

1.00 

5.00 

All MOS Combined a 

13,649 

3.03 

0.83 

1.00 

5.00 

In-Unit 

Army-Wide 






Can Do b 

5,622 

4.96 

1.28 

1.00 

7.00 

Effort & Personal Discipline b 

5,613 

5.25 

1.36 

1.00 

7.00 

Physical Fitness & Bearing 

5,600 

5.30 

1.56 

1.00 

7.00 

Self-Management b 

5,592 

5.35 

1.14 

1.00 

7.00 

Working with Others b 

5,620 

5.34 

1.22 

1.00 

7.00 

Adjustment to Army Life 

5,557 

5.40 

1.51 

1.00 

7.00 

Overall Leadership Potential 

5,507 

4.80 

1.68 

1.00 

7.00 


Note. Ratings on IMT PRS range from I to 5. Ratings on IU PRS range from 1 to 7. PRS ratings from supervisors with a 
familiarity rating of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. 
a Includes 11B/C/X + 18X, 19K. 31B.42A, 68W. 88M. and91B. 
b Ratings composite comprises two or more Army-wide PRS. 
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Table C.3. Descriptive Statistics Estimates for the Army Life Questionnaire (ALQ) in the Full 
IMT and In-Unit Samples 


Setting/Scale 

n 

M 

SD 

Min 

Max 

IMT 

Affective Commitment 

60.097 

3.89 

0.68 

1.00 

5.00 

Army Fit 

60.097 

4.08 

0.60 

1.00 

5.00 

MOS Fit 

60.097 

3.77 

0.84 

1.00 

5.00 

Normative Commitment 

60.097 

4.17 

0.70 

1.00 

5.00 

Army Career Intentions 

60.097 

3.21 

1.10 

1.00 

5.00 

Army Reenlistment Intentions 

60.097 

3.49 

0.96 

1.00 

5.00 

Attrition Cognition 

60.097 

1.52 

0.60 

1.00 

5.00 

Army Life Adjustment 

60.097 

4.09 

0.66 

1.00 

5.00 

Disciplinary Incidents (#) 

47,856 

0.29 

0.64 

0.00 

7.00 

Disciplinary Incidents (Y/N) 

47,856 

0.22 

0.41 

0.00 

1.00 

APFT Score 

58,286 

252.48 

28.62 

180.00 

300.00 

Training Achievement (#) 

60,059 

0.40 

0.61 

0.00 

2.00 

Training Failures (#) a 

58,944 

0.08 

0.29 

0.00 

2.00 

In-Unit 

Affective Commitment 

7,179 

3.55 

0.82 

1.00 

5.00 

Army Fit 

7,179 

3.86 

0.72 

1.00 

5.00 

MOS Fit 

7,179 

3.23 

0.94 

1.00 

5.00 

MOS Satisfaction 

7,179 

3.48 

0.92 

1.00 

5.00 

Army Career Intentions 

7,179 

2.61 

1.21 

1.00 

5.00 

Army Reenlistment Intentions 

7,179 

3.00 

1.18 

1.00 

5.00 

Attrition Cognition 

7,179 

1.73 

0.76 

1.00 

5.00 

Disciplinary Incidents (#) 

7,178 

0.44 

0.94 

0.00 

7.00 

Disciplinary Incidents (Y/N) 

7,178 

0.26 

0.44 

0.00 

1.00 

APFT Score 

6,850 

251.76 

28.69 

180.00 

300.00 


“Training Failures (#) is based on the total number of affirmative responses to whether a Soldier Restarted from BCT or OSUT or 
whether a Soldier repeated a block or module at AIT or OSUT. 
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Table C.4. Correlations among the Performance Rating Scales (PRS) in the Full IMT Sample 


Domain/PRS 

1 

2 

3 

4 

5 

6 


Army-Wide 







1 . 

Adjustment to the Army 







2. 

Effort & Personal Discipline 

.75 






3. 

MOS Qualification Knowledge 

.71 

.67 





4. 

Physical Fitness & Bearing 

.68 

.69 

.61 




5. 

Working with Others 

.73 

.75 

.69 

.65 



6. 

Overall Performance 

.58 

.58 

.56 

.54 

.54 



MOS-Specific 







6. 

11B/C/X + 18X 

.68 

.65 

.71 

.61 

.68 

.54 

7. 

19K 

.59 

.59 

.72 

.55 

.47 

.70 

8. 

31B 

.64 

.63 

.70 

.54 

.65 

.57 

9. 

42A 

.66 

.64 

.68 

.44 

.65 

.72 

10. 

68W 

.59 

.55 

.65 

.50 

.60 

.37 

11. 

88M 

.60 

.54 

.64 

.55 

.58 

.50 

12. 

91B 

.72 

.67 

.80 

.66 

.72 

.57 

13. 

All MOS Combined a 

.66 

.63 

.70 

.57 

.65 

.50 


Note. Army-wide PRS: n = 17,522-19,495. MOS-specifie PRS: 11B, n = 4,853-4,859; 19K, n = 572-573; 31B, n = 2,569-2,585; 
42A, n = 491; 68W, n = 2,183-2,721; 88M, n = 605-623; 91B, n = 257-276; All MOS Combined, n = 11,584-12,126. Ratings on 
IMT PRS range from 1 and 5. PRS ratings from supervisors with a familiarity rating of 1 (“I have had little opportunity to 
observe this Soldier”) were excluded from analyses. All correlations are statistically significant (p < .05, one-tailed). 

“Includes 11B/C/X + 18X, 19K, 31B.42A, 68W, 88M, and 91B. 


Table C.5. Correlations among Performance Rating Scales (PRS) in the Full In-Unit Sample 


Domain/PRS 

1 

2 

3 

4 

5 

6 

1. Can Do a 







2. Effort & Personal Discipline a 

.78 






3. Physical Fitness & Bearing 

.56 

.60 





4. Self-Management a 

.75 

.75 

.59 




5. Working with Others a 

.79 

.77 

.55 

.73 



6. Adjustment to Army Life 

.65 

.70 

.63 

.69 

.64 


7. Overall Leadership Potential 

.69 

.70 

.60 

.69 

.64 

.70 


Note. Army-wide PRS, n = 5,445-5,622. Ratings on PRS range from 1 to 7. PRS ratings from supervisors with a familiarity rating 
of 1 (“I have had little opportunity to observe this Soldier”) were excluded from analyses. All correlations are statistically 
significant (p < .05, one-tailed). 

“Ratings composite comprises two or more Army-wide PRS. 
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Table C.6. Correlations among Army Life Questionnaire (ALQ) Scales in the Full IMT and In-Unit Samples 


Scale 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

1 . 

Affective Commitment 


.78 

.40 

.53 


.61 

.55 

-.57 


-.15 

-.14 

.04 

2. 

Army Fit 

.84 


.44 

.54 


.60 

.57 

-.65 


-.22 

-.19 

.08 

3. 

MOS Fit 

.47 

.48 


.56 


.27 

.23 

-.32 


-.12 

-.11 

.03 

4. 

MOS Satisfaction 






.37 

.30 

-.37 


-.13 

-.11 

.01 

5. 

Normative Commitment 

.69 

.71 

.40 










6. 

Army Career Intentions 

.56 

.54 

.25 


.43 


.82 

-.48 


-.12 

-.11 

.04 

7. 

Army Reenlistment Intentions 

.54 

.54 

.27 


.46 

.85 


-.45 


-.10 

-.09 

.04 

8. 

Attrition Cognition 

-.63 

-.68 

-.41 


-.73 

-.47 

-.50 



.23 

.19 

-.11 

9. 

Army Life Adjustment 

.45 

.61 

.34 


.45 

.36 

.40 

-.52 





10. 

Disciplinary Incidents (#) 

-.08 

-.11 

-.08 


-.08 

-.05 

-.05 

.12 

-.17 


.79 

-.06 

11. 

Disciplinary Incidents (Y/N) 

-.06 

-.09 

-.07 


-.05 

-.05 

-.05 

.09 

-.16 

.86 


-.08 

12. 

APFT Score 

.04 

.10 

.07 


.06 

.03 

.04 

-.10 

.23 

-.13 

-.16 


13. 

Training Achievement (#) 

.06 

.07 

.05 


.00 

.09 

.07 

-.04 

.13 

-.07 

-.09 

.24 

14. 

Training Failures (#) d 

-.03 

-.05 

-.04 


-.03 

-.01 

-.02 

.06 

-.09 

.15 

.13 

-.05 


Note. Correlations below the diagonal are based on the Full IMT sample, n = 46,455-60,097. Correlations above the diagonal are based on the Full In-Unit sample, n = 
6,849-7,179. Missing values reflect the scales that were not administered in either IMT or In-Unit. Correlations in bold are statistically significant (p < .05, two-tailed). 
“Training Failures (#) is based on the total number of affirmative responses to whether a Soldier restarted from BCT or OSUT or whether a Soldier repeated a block or 
module at AIT or OSUT. 
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APPENDIX D 


SUMMARY OF BIVARIATE CORRELATIONS BETWEEN TAPAS SCALES AND SELECTED CRITERIA 


Table D.l. Summary of the Bivariate Correlations between AFQT, TAPAS and Selected IMT Criteria for Tier 1+2 Soldiers 



Knowledge & 
Skill 

WTBD 

JKT 

Disciplinary 
Incidents (Y/N) 

IMT 

Restarts 

Can Do 
Performance 

Army 

Fit 

Army Life 
Adjustment 

Commitment & 
Fit 

n 

2,725-17,737 

3,717-22,866 

3,900 - 22,420 

60,912 - 290,220 

3,752 - 23,048 

3,903 - 24,034 

3,903 - 24,034 

3,903 - 24,034 

AFQT 

.45 

.43 

-.03 

.00 

.44 

-.04 

.06 

.01 

Individual TAPAS Scales 

Achievement 

.04 

.04 

-.07 

-.01 

.04 

.13 

.14 

.12 

Adjustment 

.08 

.06 

-.02 

.00 

.07 

.03 

.10 

.03 

Adventure Seeking a 

.06 

.08 

-.04 

-.01 

.07 

.02 

.08 

.05 

Attention Seeking 

.01 

.02 

-.02 

.00 

.01 

.04 

.08 

.04 

Commitment to Serve a 

-.06 

-.06 

.01 

.01 

-.07 

.12 

.09 

.14 

Cooperation 

-.02 

-.02 

.00 

.00 

-.02 

.01 

-.01 

.01 

Courage a 

.03 

.07 

-.06 

.00 

.05 

.12 

.14 

.12 

Dominance 

.02 

.04 

-.05 

-.01 

.03 

.10 

.13 

.09 

Even Tempered 

.05 

.05 

-.02 

.01 

.05 

.03 

.04 

.02 

Intellectual Efficiency 

.18 

.16 

-.03 

.01 

.17 

.04 

.12 

.03 

Non-Delinquency 

-.01 

-.01 

-.02 

.00 

-.02 

.06 

.02 

.04 

Optimism 

.01 

.01 

-.03 

-.01 

.01 

.07 

.10 

.06 

Order 

-.08 

-.08 

-.02 

.01 

-.08 

.03 

.02 

.00 

Physical Conditioning 

.00 

.01 

-.10 

-.03 

.00 

.05 

.13 

.05 

Responsibility a 

.06 

.05 

-.01 

.00 

.06 

.09 

.10 

.09 

Self-Control 

.00 

.00 

-.01 

.01 

.00 

.04 

.04 

.03 

Selflessness 

-.04 

-.03 

.02 

.00 

-.04 

.05 

-.01 

.04 

Situational Awareness a 

.04 

.03 

-.04 

.01 

.03 

.04 

.07 

.03 

Sociability 

-.10 

-.08 

.01 

.00 

-.09 

.04 

.04 

.04 

Team Orientation a 

-.04 

-.02 

-.04 

.00 

-.04 

.04 

.01 

.04 

Tolerance 

-.01 

-.02 

.01 

.01 

-.02 

.05 

.03 

.03 

TAPAS Composites 

Can-Do 

.24 

.22 

-.02 

.00 

.23 

.01 

.09 

.02 

Will-Do 

.03 

.03 

-.11 

-.03 

.03 

.13 

.20 

.12 

Adaptation 

.09 

.08 

-.08 

-.02 

.08 

.03 

.10 

.04 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAPAS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAPAS. 
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Table D.l. (Continued) 



Retention 

Cognitions 

APFT Score 

Will Do 
Performance 

PRS: Effort & 
Discipline 

PRS: 

Adjustment to 
the Army 

PRS: Physical 
Fitness and 
Bearing 

PRS: Working 
with Others 

PRS: Overall 
Performance 

n 

3,903 - 24,034 

3,771 -23,349 

433 - 3,511 

1,051 - 7,069 

1,051 - 7,066 

1,049 - 7,055 

1,041 - 7,031 

934 - 6,529 

AFQT 

-.13 

.09 

.05 

.08 

.05 

.06 

.07 

.08 

Individual TAPAS Scales 

Achievement 

.06 

.09 

.15 

.07 

.06 

.06 

.06 

.08 

Adjustment 

.00 

.01 

.03 

-.03 

-.02 

.00 

-.02 

-.03 

Adventure Seeking a 

-.01 

.08 

.09 

.01 

-.04 

.03 

.01 

.00 

Attention Seeking 

-.02 

.09 

.08 

.00 

.00 

.03 

.01 

.01 

Commitment to Serve a 

.25 

-.05 

.06 

.03 

.01 

-.01 

.03 

.02 

Cooperation 

.00 

-.02 

-.03 

-.01 

.01 

.00 

.00 

-.01 

Courage a 

.06 

.03 

.15 

-.01 

-.01 

.01 

-.03 

-.02 

Dominance 

.06 

.12 

.16 

.04 

.05 

.06 

.04 

.06 

Even Tempered 

.02 

-.05 

-.01 

.00 

-.01 

-.01 

.01 

.00 

Intellectual Efficiency 

.02 

.04 

.06 

.03 

.01 

.01 

.03 

.03 

Non-Delinquency 

.03 

-.05 

-.01 

.00 

-.01 

-.03 

-.01 

-.02 

Optimism 

.00 

.04 

.10 

.03 

.03 

.02 

.02 

.03 

Order 

.04 

.03 

.03 

.01 

.00 

.02 

.01 

.01 

Physical Conditioning 

-.03 

.28 

.25 

.07 

.07 

.14 

.06 

.09 

Responsibility a 

.02 

.00 

.09 

.09 

.06 

.02 

.04 

.08 

Self-Control 

.03 

-.01 

.02 

.01 

.00 

-.01 

.00 

.00 

Selflessness 

.04 

-.01 

-.02 

-.01 

.00 

-.01 

-.01 

-.01 

Situational Awareness a 

.05 

-.01 

.02 

.03 

.01 

-.02 

-.01 

-.01 

Sociability 

.03 

.03 

.06 

-.02 

.01 

.01 

.00 

.00 

Team Orientation a 

.04 

.02 

.03 

.00 

.01 

-.02 

-.03 

-.01 

Tolerance 

.05 

.00 

-.01 

.00 

.00 

.00 

.00 

.00 

TAPAS Composites 

Can-Do 

-.01 

.00 

.02 

.02 

.01 

.00 

.02 

.02 

Will-Do 

.02 

.26 

.29 

.09 

.09 

.14 

.08 

.12 

Adaptation 

-.04 

.18 

.17 

.06 

.05 

.10 

.04 

.07 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 
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Table D.2. Summary of the Bivariate Correlations between AFQT, TAP AS and Selected IMT Criteria for Tier 1 Soldiers 



Knowledge & 

WTBD 

Disciplinary 

IMT 

Can Do 

Army 

Army Life 

Commitment & 


Skill 

JKT 

Incidents (Y/N) 

Restarts 

Performance 

Fit 

Adjustment 

Fit 

n 

2,623 -17,075 

3,582-21,977 

3,760 - 21,539 

58,613 - 278,633 

3,617-22,152 

3,762 - 23,106 

3,762 - 23,106 

3,762 - 23,106 

AFQT 

Individual TAPAS Scales 

.46 

.43 

-.03 

.00 

.44 

-.04 

.06 

.01 

Achievement 

.04 

.03 

-.07 

-.01 

.04 

.13 

.14 

.12 

Adjustment 

.08 

.06 

-.02 

.00 

.07 

.03 

.10 

.03 

Adventure Seeking a 

.06 

.09 

-.05 

-.01 

.07 

.02 

.08 

.05 

Attention Seeking 

.01 

.02 

-.02 

.00 

.01 

.04 

.08 

.04 

Commitment to Serve a 

-.07 

-.07 

.01 

.01 

-.07 

.12 

.09 

.14 

Cooperation 

-.02 

-.02 

.00 

.00 

-.02 

.01 

-.01 

.01 

Courage a 

.03 

.07 

-.06 

.00 

.04 

.12 

.14 

.13 

Dominance 

.02 

.04 

-.05 

-.01 

.03 

.10 

.13 

.09 

Even Tempered 

.05 

.05 

-.02 

.01 

.05 

.03 

.04 

.02 

Intellectual Efficiency 

.18 

.16 

-.03 

.01 

.17 

.04 

.12 

.03 

Non-Delinquency 

-.01 

-.01 

-.02 

.00 

-.02 

.06 

.01 

.04 

Optimism 

.01 

.01 

-.04 

-.01 

.01 

.07 

.10 

.06 

Order 

-.08 

-.08 

-.02 

.01 

-.08 

.02 

.01 

.00 

Physical Conditioning 

.00 

.01 

-.10 

-.03 

.00 

.05 

.13 

.05 

Responsibility a 

.05 

.05 

-.01 

-.01 

.06 

.09 

.10 

.09 

Self-Control 

.00 

.00 

-.01 

.01 

.00 

.05 

.04 

.03 

Selflessness 

-.04 

-.03 

.02 

.00 

-.04 

.05 

-.01 

.05 

Situational Awareness a 

.04 

.03 

-.04 

.01 

.03 

.04 

.07 

.03 

Sociability 

-.10 

-.08 

.01 

.00 

-.10 

.04 

.04 

.03 

Team Orientation a 

-.04 

-.02 

-.04 

.00 

-.04 

.04 

.01 

.04 

Tolerance 

-.01 

-.02 

.01 

.01 

-.02 

.05 

.03 

.03 

TAPAS Composites 









Can-Do 

.24 

.22 

-.02 

.00 

.24 

.01 

.09 

.02 

Will-Do 

.03 

.04 

-.11 

-.03 

.03 

.13 

.20 

.12 

Adaptation 

.09 

.09 

-.08 

-.02 

.09 

.03 

.10 

.04 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 



D-4 


Table D.2. (Continued) 



Retention 

Cognitions 

APFT Score 

Will Do 
Performance 

PRS: Effort & 
Discipline 

PRS: 

Adjustment to 
the Army 

PRS: Physical 
Fitness and 
Bearing 

PRS: Working 
with Others 

PRS: Overall 
Performance 

n 

3,762 - 23,106 

3,635 - 22,456 

418 - 3,387 

1,013-6,797 

1,013-6,794 

1,011 - 6,783 

1,004 - 6,763 

899 - 6,274 

AFQT 

-.13 

.09 

.05 

.09 

.05 

.06 

.07 

.08 

Individual TAPAS Scales 

Achievement 

.06 

.09 

.15 

.08 

.07 

.06 

.06 

.08 

Adjustment 

-.01 

.01 

.03 

-.03 

-.02 

-.01 

-.02 

-.03 

Adventure Seeking a 

.00 

.08 

.08 

.00 

-.04 

.02 

.00 

-.01 

Attention Seeking 

-.02 

.09 

.09 

.00 

.00 

.03 

.00 

.01 

Commitment to Serve a 

.25 

-.05 

.06 

.04 

.02 

.00 

.04 

.03 

Cooperation 

.00 

-.03 

-.04 

-.01 

.00 

.00 

.00 

-.01 

Courage a 

.05 

.03 

.15 

-.02 

-.01 

.01 

-.03 

-.02 

Dominance 

.06 

.12 

.16 

.04 

.05 

.06 

.04 

.06 

Even Tempered 

.02 

-.04 

-.01 

.00 

-.01 

-.01 

.01 

.00 

Intellectual Efficiency 

.02 

.04 

.06 

.02 

.01 

.01 

.02 

.03 

Non-Delinquency 

.03 

-.05 

-.01 

.00 

-.01 

-.03 

-.01 

-.02 

Optimism 

.00 

.04 

.09 

.02 

.02 

.02 

.01 

.02 

Order 

.04 

.03 

.03 

.01 

.00 

.01 

.01 

.01 

Physical Conditioning 

-.03 

.28 

.25 

.07 

.07 

.15 

.05 

.09 

Responsibility a 

.02 

.01 

.09 

.10 

.08 

.01 

.05 

.08 

Self-Control 

.03 

-.01 

.01 

.01 

.00 

-.01 

.00 

.00 

Selflessness 

.05 

-.01 

-.01 

.00 

.00 

-.01 

-.01 

-.01 

Situational Awareness a 

.05 

-.01 

.05 

.04 

.02 

-.02 

.00 

.00 

Sociability 

.02 

.03 

.06 

-.02 

.00 

.01 

.00 

-.01 

Team Orientation a 

.04 

.02 

.02 

.00 

.01 

-.02 

-.04 

-.02 

Tolerance 

.05 

.00 

-.01 

.00 

-.01 

.00 

.00 

.00 

TAPAS Composites 

Can-Do 

.00 

.00 

.02 

.02 

.01 

-.01 

.02 

.02 

Will-Do 

.02 

.25 

.29 

.09 

.09 

.14 

.07 

.11 

Adaptation 

-.04 

.18 

.17 

.05 

.05 

.10 

.04 

.07 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant ip < .01, two-tailed). 
“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 
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Table D.3. Summary of the Bivariate Correlations between AFQT, TAP AS and Selected IMT Criteria for Tier 2 Soldiers 



Knowledge & 
Skill 

WTBD 

JKT 

Disciplinary 
Incidents (Y/N) 

IMT 

Restarts 

Can Do 
Performance 

Army 

Fit 

Army Life 
Adjustment 

Commitment & 
Fit 

n 

102 - 662 

135 - 889 

140 - 881 

2,299 - 11,587 

135 - 896 

141 - 928 

141 - 928 

141 - 928 

AFQT 

.38 

.34 

.02 

.03 

.36 

-.05 

-.01 

-.03 

Individual TAPAS Scales 

Achievement 

.03 

.04 

-.09 

.00 

.04 

.12 

.18 

.12 

Adjustment 

.07 

.04 

.04 

.00 

.06 

.02 

.11 

.02 

Adventure Seeking a 

.01 

.02 

.17 

.01 

.04 

-.13 

.01 

-.15 

Attention Seeking 

-.01 

.00 

.07 

.00 

.00 

.05 

.06 

.04 

Commitment to Serve a 

.25 

.01 

.00 

-.01 

.09 

.11 

.10 

.05 

Cooperation 

-.02 

-.04 

.02 

.01 

-.05 

.02 

.02 

.03 

Courage a 

.10 

.16 

.05 

.00 

.12 

.07 

.17 

.01 

Dominance 

.04 

.03 

-.08 

.01 

.03 

.10 

.14 

.09 

Even Tempered 

.07 

.07 

.03 

.01 

.07 

.04 

.08 

.03 

Intellectual Efficiency 

.13 

.09 

.04 

.03 

.11 

.03 

.07 

.02 

Non-Delinquency 

.01 

.01 

-.01 

.00 

-.01 

.10 

.08 

.08 

Optimism 

-.03 

-.02 

.03 

.01 

-.04 

.09 

.11 

.10 

Order 

-.08 

-.05 

.00 

.01 

-.07 

.06 

.06 

.04 

Physical Conditioning 

-.05 

-.06 

-.05 

-.01 

-.04 

.08 

.11 

.09 

Responsibility a 

.11 

.04 

.00 

.03 

.06 

.08 

.04 

.02 

Self-Control 

.03 

.03 

-.06 

.03 

.04 

.03 

.00 

.01 

Selflessness 

-.01 

-.04 

.06 

.00 

-.03 

.00 

-.01 

.03 

Situational Awareness a 

.02 

.03 

.02 

.03 

.06 

-.04 

.05 

-.01 

Sociability 

.00 

-.01 

.00 

-.01 

-.01 

.13 

.10 

.11 

Team Orientation a 

-.05 

-.01 

-.03 

.00 

-.04 

.06 

.09 

.03 

Tolerance 

-.03 

-.04 

-.01 

.02 

-.05 

.02 

.01 

.00 

TAPAS Composites 

Can-Do 

.17 

.14 

.02 

.02 

.16 

.01 

.03 

.00 

Will-Do 

-.01 

-.02 

-.09 

.00 

-.01 

.16 

.21 

.16 

Adaptation 

.03 

.00 

-.03 

-.01 

.02 

.01 

.06 

.03 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations based on fewer than 100 cases are not reported. 
Correlations in bold are statistically significant (p < .01, two-tailed). 

“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 
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Table D.3. (Continued) 



Retention 

Cognitions 

APFT Score 

Will Do 
Performance 

PRS: Effort & 
Discipline 

PRS: 

Adjustment to 
the Army 

PRS: Physical 
Fitness and 
Bearing 

PRS: Working 
with Others 

PRS: Overall 
Performance 

n 

141 - 928 

136 - 893 

109 - 124 

176 - 272 

176 - 272 

176 - 272 

174 - 268 

166 - 255 

AFQT 

-.14 

.08 

-.03 

.05 

.04 

.04 

.05 

.10 

Individual TAPAS Scales 

Achievement 

.05 

.10 

.13 

.03 

-.02 

.06 

.00 

.03 

Adjustment 

.02 

.02 

.04 

-.07 

-.03 

.08 

-.03 

-.06 

Adventure Seeking a 

-.11 

.12 

- 

- 

- 

- 

- 

- 

Attention Seeking 

-.03 

.06 

-.15 

.03 

.01 

.02 

.09 

.05 

Commitment to Serve a 

.34 

-.10 

- 

- 

- 

- 

- 

- 

Cooperation 

-.03 

.00 

- 

.01 

.07 

-.03 

.06 

.03 

Courage a 

.18 

.03 

- 

- 

- 

- 

- 

- 

Dominance 

.04 

.16 

.09 

.05 

.00 

.08 

.04 

.07 

Even Tempered 

.00 

-.07 

.11 

.02 

.02 

.02 

.07 

.02 

Intellectual Efficiency 

-.03 

.03 

.01 

.08 

.03 

.09 

.07 

.08 

Non-Delinquency 

.02 

-.06 

-.07 

.03 

-.01 

-.10 

.00 

-.04 

Optimism 

.01 

.10 

.08 

.13 

.16 

.18 

.15 

.14 

Order 

.05 

.01 

- 

.03 

-.02 

.06 

.02 

.03 

Physical Conditioning 

.06 

.25 

.19 

.09 

.04 

.08 

.08 

.08 

Responsibility a 

.00 

-.11 

- 

- 

- 

- 

- 

- 

Self-Control 

-.04 

-.04 

.14 

.01 

.00 

-.02 

-.02 

-.01 

Selflessness 

-.05 

.05 

- 

-.06 

-.03 

-.05 

-.08 

-.07 

Situational Awareness a 

.01 

-.10 

- 

- 

- 

- 

- 

- 

Sociability 

.09 

.04 

.09 

.02 

.07 

.04 

.05 

.05 

Team Orientation a 

-.04 

.04 

- 

- 

- 

- 

- 

- 

Tolerance 

.03 

.07 

.10 

.00 

.03 

.00 

.04 

.00 

TAPAS Composites 

Can-Do 

-.07 

-.01 

- 

.08 

.04 

.11 

.08 

.09 

Will-Do 

.07 

.27 

.24 

.12 

.05 

.14 

.10 

.12 

Adaptation 

.00 

.16 

.10 

.05 

.01 

.03 

.07 

.04 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations based on fewer than 100 cases are not reported. 
Correlations in bold are statistically significant (p < .01, two-tailed). 

“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 
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Table D.4. Summary of the Bivariate Correlations between AFQT, TAPAS and Selected In-Unit Criteria for Tier 1+2 Soldiers 



Knowledge & 
Skill 

WTBD 

JKT 

Disciplinary 
Incidents (Y/N) 

Army 

Fit 

MOS 

Fit 

Commitment & 
Fit 

Retention 

Cognitions 

n 

374 - 2,795 

374-2,788 

381 - 2,831 

381 - 2,831 

381 - 2,831 

381 - 2,831 

381 - 2,831 

AFQT 

.46 

.45 

-.05 

-.03 

.01 

-.03 

-.12 

Individual TAPAS Scales 

Achievement 

.04 

.04 

-.08 

.08 

.03 

.06 

.04 

Adjustment 

.08 

.08 

-.02 

.02 

.00 

.01 

-.02 

Adventure Seeking a 

.05 

.06 

.01 

-.07 

-.12 

-.09 

-.06 

Attention Seeking 

.02 

.03 

.02 

.01 

-.01 

.00 

-.04 

Commitment to Serve a 

-.09 

-.10 

.11 

.01 

.09 

.05 

.15 

Cooperation 

.00 

.01 

-.03 

.03 

.00 

.03 

.03 

Courage a 

.04 

.05 

-.01 

.10 

.10 

.10 

-.03 

Dominance 

.01 

.02 

-.02 

.06 

-.01 

.03 

.06 

Even Tempered 

.06 

.07 

-.06 

.09 

.02 

.06 

.03 

Intellectual Efficiency 

.19 

.18 

-.04 

.04 

.01 

.03 

-.01 

Non-Delinquency 

-.02 

-.01 

-.05 

.07 

.02 

.05 

.05 

Optimism 

.01 

.01 

-.05 

.07 

.05 

.07 

.02 

Order 

-.11 

-.10 

-.05 

.02 

-.02 

.01 

.07 

Physical Conditioning 

-.03 

-.01 

-.04 

.00 

.02 

.01 

-.02 

Responsibility a 

.07 

.08 

-.10 

.14 

.03 

.11 

.05 

Self-Control 

.01 

.01 

-.07 

.05 

-.01 

.04 

.04 

Selflessness 

-.05 

-.05 

.01 

.04 

-.02 

.03 

.03 

Situational Awareness a 

.06 

.05 

-.05 

.08 

.01 

.06 

.06 

Sociability 

-.10 

-.09 

.01 

.04 

.01 

.04 

.03 

Team Orientation a 

-.01 

.01 

.05 

.07 

.02 

.07 

.00 

Tolerance 

-.03 

-.05 

.04 

.05 

-.02 

.03 

.04 

TAPAS Composites 

Can-Do 

.26 

.26 

-.05 

.00 

.01 

.00 

-.05 

Will-Do 

.00 

.02 

-.07 

.06 

.03 

.06 

.02 

Adaptation 

.08 

.10 

-.04 

.02 

.03 

.02 

-.05 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAPAS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAPAS. 



Table D.4. (Continued) 



APFT Score 

PRS: Effort & 
Discipline 

PRS: Working 
with Others 

PRS: Physical 
Fitness & 
Bearing 

PRS: Leadership 
Potential 

PRS: Overall 
Performance 

n 

370 - 2,713 

319-2,264 

319-2,265 

319-2,255 

311 - 2,208 

318 - 2,261 

AFQT 

-.01 

.10 

.12 

.03 

.08 

.09 

Individual TAPAS Scales 

Achievement 

.07 

.07 

.07 

.07 

.10 

.08 

Adjustment 

.01 

.00 

-.01 

-.02 

-.03 

-.01 

Adventure Seeking a 

.19 

-.02 

.00 

.06 

-.01 

.00 

Attention Seeking 

.05 

-.02 

.00 

.01 

.02 

.00 

Commitment to Serve a 

.02 

.00 

.00 

.04 

.02 

.01 

Cooperation 

-.03 

-.02 

.01 

.00 

-.03 

.00 

Courage a 

.05 

-.08 

-.08 

-.06 

-.10 

-.08 

Dominance 

.12 

.03 

.05 

.05 

.05 

.04 

Even Tempered 

-.04 

-.01 

.03 

-.02 

.03 

.00 

Intellectual Efficiency 

.02 

.03 

.06 

.01 

.02 

.04 

Non-Delinquency 

-.07 

.01 

.03 

-.01 

.01 

.01 

Optimism 

.03 

.00 

.03 

.05 

.02 

.03 

Order 

.06 

-.01 

-.01 

-.01 

.00 

-.01 

Physical Conditioning 

.27 

.05 

.05 

.12 

.06 

.08 

Responsibility a 

.00 

.05 

.07 

.06 

.11 

.09 

Self-Control 

.00 

.01 

.03 

-.01 

.02 

.01 

Selflessness 

-.04 

.01 

.01 

-.01 

.01 

.00 

Situational Awareness a 

.02 

.01 

.02 

.07 

.07 

.05 

Sociability 

.06 

-.02 

.00 

.00 

-.01 

-.01 

Team Orientation a 

.04 

-.03 

-.02 

-.04 

.00 

-.02 

Tolerance 

.01 

-.03 

-.01 

-.03 

-.02 

-.04 

TAPAS Composites 

Can-Do 

-.04 

.06 

.06 

.02 

.04 

.05 

Will-Do 

.24 

.07 

.09 

.13 

.10 

.10 

Adaptation 

.15 

.05 

.06 

.09 

.06 

.07 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 
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Table D.5. Summary of the Bivariate Correlations between AFQT, TAPAS and Selected In-Unit Criteria for Tier 1 Soldiers 



Knowledge & 
Skill 

WTBD 

JKT 

Disciplinary 
Incidents (Y/N) 

Army 

Fit 

MOS 

Fit 

Commitment & 
Fit 

Retention 

Cognitions 

n 

359-2,712 

359-2,705 

365-2,745 

365-2,745 

365-2,745 

365-2,745 

365-2,745 

AFQT 

.46 

.45 

-.05 

-.03 

.01 

-.03 

-.12 

Individual TAPAS Scales 

Achievement 

.04 

.04 

-.08 

.08 

.03 

.07 

.04 

Adjustment 

.08 

.09 

-.01 

.02 

.00 

.01 

-.03 

Adventure Seeking a 

.06 

.06 

.00 

-.08 

-.12 

-.10 

-.07 

Attention Seeking 

.02 

.03 

.02 

.00 

-.01 

.00 

-.03 

Commitment to Serve a 

-.10 

-.11 

.09 

.03 

.08 

.05 

.17 

Cooperation 

.00 

.01 

-.02 

.04 

.00 

.03 

.03 

Courage a 

.05 

.06 

-.02 

.09 

.09 

.09 

-.04 

Dominance 

.01 

.02 

-.01 

.06 

-.02 

.03 

.05 

Even Tempered 

.07 

.07 

-.06 

.09 

.01 

.06 

.03 

Intellectual Efficiency 

.19 

.18 

-.04 

.05 

.02 

.03 

.00 

Non-Delinquency 

-.01 

-.01 

-.06 

.07 

.01 

.06 

.05 

Optimism 

.01 

.00 

-.04 

.07 

.04 

.07 

.02 

Order 

-.11 

-.11 

-.06 

.01 

-.02 

.01 

.07 

Physical Conditioning 

-.03 

-.01 

-.04 

.00 

.02 

.01 

-.02 

Responsibility a 

.06 

.07 

-.11 

.14 

.03 

.11 

.05 

Self-Control 

.01 

.01 

-.07 

.05 

-.01 

.04 

.04 

Selflessness 

-.05 

-.05 

.02 

.04 

-.02 

.03 

.03 

Situational Awareness a 

.05 

.04 

-.05 

.06 

.00 

.04 

.06 

Sociability 

-.09 

-.09 

.01 

.05 

.01 

.05 

.03 

Team Orientation a 

.00 

.01 

.05 

.09 

.03 

.08 

.01 

Tolerance 

-.02 

-.04 

.04 

.04 

-.02 

.03 

.04 

TAPAS Composites 

Can-Do 

.27 

.26 

-.05 

.01 

.01 

.00 

-.05 

Will-Do 

.00 

.02 

-.07 

.06 

.03 

.06 

.02 

Adaptation 

.09 

.10 

-.03 

.01 

.03 

.01 

-.04 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAPAS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAPAS. 



D-10 


Table D.5. (Continued) 



APFT Score 

PRS: Effort & 
Discipline 

PRS: Working 
with Others 

PRS: Physical 
Fitness & 
Bearing 

PRS: Leadership 
Potential 

PRS: Overall 
Performance 

n 

355 - 2,632 

304 - 2,193 

304 - 2,194 

304 - 2,185 

296 - 2,137 

303 - 2,190 

AFQT 

-.01 

.10 

.12 

.03 

.07 

.09 

Individual TAPAS Scales 

Achievement 

.07 

.07 

.07 

.07 

.10 

.08 

Adjustment 

.01 

.00 

-.01 

-.02 

-.02 

-.01 

Adventure Seeking a 

.19 

.00 

.01 

.08 

.01 

.02 

Attention Seeking 

.05 

-.01 

.00 

.01 

.02 

.01 

Commitment to Serve a 

.02 

-.02 

-.03 

.03 

.00 

-.01 

Cooperation 

-.03 

-.01 

.01 

.00 

-.02 

.00 

Courage a 

.05 

-.09 

-.09 

-.06 

-.10 

-.08 

Dominance 

.11 

.03 

.05 

.05 

.04 

.04 

Even Tempered 

-.04 

.00 

.02 

-.02 

.02 

.00 

Intellectual Efficiency 

.02 

.03 

.05 

.01 

.02 

.04 

Non-Delinquency 

-.07 

.02 

.03 

-.01 

.02 

.02 

Optimism 

.03 

.00 

.04 

.05 

.02 

.04 

Order 

.06 

-.01 

-.01 

-.01 

.00 

.00 

Physical Conditioning 

.26 

.05 

.05 

.12 

.06 

.07 

Responsibility a 

.01 

.07 

.08 

.06 

.12 

.10 

Self-Control 

-.01 

.01 

.02 

-.01 

.02 

.01 

Selflessness 

-.04 

.01 

.01 

.00 

.01 

.00 

Situational Awareness a 

.03 

.02 

.04 

.07 

.07 

.06 

Sociability 

.06 

-.02 

.00 

.00 

.00 

-.01 

Team Orientation a 

.04 

-.03 

-.01 

-.04 

.00 

-.02 

Tolerance 

.01 

-.02 

-.01 

-.03 

-.01 

-.03 

TAPAS Composites 

Can-Do 

-.04 

.05 

.05 

.02 

.03 

.05 

Will-Do 

.24 

.07 

.08 

.13 

.10 

.10 

Adaptation 

.15 

.04 

.05 

.09 

.06 

.06 


Note. WTBD JKT = Warrior Tasks and Battle Drills Job Knowledge Test. PRS = Performance Rating Scales. Correlations in bold are statistically significant (p < .01, two-tailed). 
“Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were administered in every version of the TAP AS. 



Table D.6. Summary of the Bivariate Correlations between AFQT, TAPAS, and Selected 
Attrition Criteria for Tier 1+2 Soldiers (Regular Army Only) 




Attrition 



6-Mos 

12-Mos 

24-Mos 

n 

32,101 - 156,712 

30,136 -136,682 

11,546 - 87,733 

AFQT 

-.06 

-.06 

-.08 

Individual TAPAS Scales 

Achievement 

-.02 

-.02 

-.02 

Adjustment 

-.01 

-.01 

.00 

Adventure Seeking a 

-.03 

-.03 

-.02 

Attention Seeking 

-.03 

-.03 

-.01 

Commitment to Serve a 

.02 

.01 

.03 

Cooperation 

.01 

.01 

.01 

Courage a 

-.01 

.00 

.00 

Dominance 

-.03 

-.03 

-.02 

Even Tempered 

.00 

.00 

-.01 

Intellectual Efficiency 

-.01 

-.01 

-.01 

Non-Delinquency 

.02 

.02 

.01 

Optimism 

-.02 

-.02 

-.02 

Order 

.01 

.01 

.01 

Physical Conditioning 

-.07 

-.08 

-.07 

Responsibility a 

.00 

.00 

-.02 

Self-Control 

.00 

.00 

.00 

Selflessness 

.03 

.03 

.03 

Situational Awareness a 

-.01 

.00 

.00 

Sociability 

.01 

.01 

.02 

Team Orientation a 

-.03 

-.03 

-.03 

Tolerance 

.01 

.01 

.01 

TAPAS Composites 

Can-Do 

-.02 

-.02 

-.03 

Will-Do 

-.06 

-.07 

-.06 

Adaptation 

-.06 

-.07 

-.07 


Note. Correlations in bold are statistically significant (p < .01, two-tailed). 

a Sample sizes for six TAPAS scales were considerably smaller than the other dimensions because not all scales were 
administered in every version of the TAPAS. 
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Table D.7. Summary of the Bivariate Correlations between AFQT, TAP AS, and Selected 
Attrition Criteria for Tier 1 Soldiers (Regular Army Only) 




Attrition 



6-Mos 

12-Mos 

24-Mos 

n 

31,239 - 151,312 

29,418 - 132,869 

11,029 - 84,503 

AFQT 

-.06 

-.06 

-.08 

Individual TAPAS Scales 

Achievement 

-.02 

-.03 

-.02 

Adjustment 

-.01 

-.01 

-.01 

Adventure Seeking a 

-.03 

-.03 

-.02 

Attention Seeking 

-.03 

-.03 

-.01 

Commitment to Serve a 

.01 

.01 

.03 

Cooperation 

.01 

.01 

.01 

Courage a 

-.01 

.00 

.00 

Dominance 

-.03 

-.03 

-.02 

Even Tempered 

.00 

.00 

-.01 

Intellectual Efficiency 

-.01 

-.01 

-.01 

Non-Delinquency 

.02 

.02 

.01 

Optimism 

-.02 

-.02 

-.02 

Order 

.01 

.01 

.01 

Physical Conditioning 

-.07 

-.08 

-.07 

Responsibility a 

.00 

.00 

-.02 

Self-Control 

.00 

.00 

.00 

Selflessness 

.03 

.03 

.03 

Situational Awareness a 

-.01 

.00 

.00 

Sociability 

.01 

.01 

.02 

Team Orientation a 

-.03 

-.03 

-.03 

Tolerance 

.01 

.01 

.01 

TAPAS Composites 

Can-Do 

-.02 

-.02 

-.03 

Will-Do 

-.06 

-.07 

-.06 

Adaptation 

-.06 

-.07 

-.07 


Note. Correlations in bold are statistically significant (p < .01, two-tailed). 

a Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were 
administered in every version of the TAP AS. 
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Table D.8. Summary of the Bivariate Correlations between AFQT, TAP AS, and Selected 
Attrition Criteria for Tier 2 Soldiers (Regular Army Only) 




Attrition 



6-Mos 

12-Mos 

24-Mos 

n 

862 - 5,400 

718 - 3,813 

517-3,230 

AFQT 

-.04 

-.02 

-.06 

Individual TAPAS Scales 

Achievement 

-.02 

-.01 

-.02 

Adjustment 

-.02 

.00 

.01 

Adventure Seeking a 

-.03 

-.04 

-.01 

Attention Seeking 

-.01 

.00 

.01 

Commitment to Serve a 

.02 

.01 

.02 

Cooperation 

.00 

.02 

.01 

Courage a 

-.02 

.00 

-.05 

Dominance 

-.01 

-.01 

-.01 

Even Tempered 

.02 

.02 

.01 

Intellectual Efficiency 

-.01 

.01 

-.01 

Non-Delinquency 

.03 

.01 

.00 

Optimism 

-.02 

-.01 

-.01 

Order 

.01 

.00 

.00 

Physical Conditioning 

-.04 

-.04 

-.03 

Responsibility a 

-.03 

.02 

-.01 

Self-Control 

.02 

.02 

.03 

Selflessness 

.04 

.03 

.04 

Situational Awareness a 

.05 

.01 

.08 

Sociability 

.00 

-.01 

.02 

Team Orientation a 

-.04 

-.04 

.00 

Tolerance 

.01 

.01 

.02 

TAPAS Composites 

Can-Do 

.00 

.03 

-.02 

Will-Do 

-.04 

-.03 

-.04 

Adaptation 

-.02 

-.02 

-.03 


Note. Correlations in bold are statistically significant (p < .01, two-tailed). 

a Sample sizes for six TAP AS scales were considerably smaller than the other dimensions because not all scales were 
administered in every version of the TAP AS. 
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